Jul 07 23:11:08.666395 ip-10-0-137-221 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.112644    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117327    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117338    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117343    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117346    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117349    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117352    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117354    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 23:11:09.121550 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117357    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117364    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117367    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117371    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117375    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117378    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117380    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117383    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117385    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117388    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117390    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117393    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117396    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117398    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117401    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117403    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117406    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117409    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117411    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 23:11:09.123017 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117414    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117417    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117420    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117424    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117428    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117431    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117433    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117436    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117438    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117441    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117443    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117447    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117451    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117453    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117456    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117459    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117461    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117464    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117467    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 23:11:09.123672 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117470    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117473    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117477    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117481    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117485    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117489    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117494    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117498    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117502    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117504    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117507    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117510    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117512    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117515    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117518    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117520    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117523    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117525    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117528    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117530    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 23:11:09.124949 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117533    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117537    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117540    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117543    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117546    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117549    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117552    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117556    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117559    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117563    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117568    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117572    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117610    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117617    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117621    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117629    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117634    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117638    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117642    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 23:11:09.125590 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117645    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117648    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117653    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117656    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117659    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117664    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117668    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117671    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117674    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117678    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117680    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117683    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117686    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117689    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.117692    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118486    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118494    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118497    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118502    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118505    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 23:11:09.127108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118508    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118511    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118515    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118518    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118521    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118524    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118529    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118532    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118535    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118539    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118541    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118544    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118546    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118550    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118552    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118555    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118558    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118561    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118564    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118566    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 23:11:09.127686 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118569    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118573    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118576    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118578    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118581    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118584    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118587    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118590    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118594    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118597    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118599    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118602    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118605    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118608    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118611    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118613    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118617    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118620    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118623    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118626    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 23:11:09.128467 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118630    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118632    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118635    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118637    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118641    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118644    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118646    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118649    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118652    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118657    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118661    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118665    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118668    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118672    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118676    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118679    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118682    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118685    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118689    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 23:11:09.129043 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118691    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118694    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118696    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118700    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118703    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118705    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118709    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118713    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118717    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118719    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118723    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118725    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118728    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118731    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118735    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118738    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118741    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118745    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118749    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118752    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 23:11:09.129728 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118754    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118758    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118761    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118764    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118768    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118773    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118776    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118781    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118784    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118786    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118789    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118793    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118795    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118798    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.118802    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119201    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119207    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119210    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119214    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 23:11:09.130345 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119218    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119221    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119224    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119227    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119230    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119233    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119237    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119240    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119242    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119246    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119250    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119253    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119255    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119265    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119269    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119273    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119276    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119280    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119285    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119288    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 23:11:09.131185 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119292    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119295    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119300    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119303    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119306    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119311    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119314    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119316    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119320    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119324    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119326    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119329    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119332    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119336    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119338    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119341    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119344    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119347    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119350    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119353    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 23:11:09.131752 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119357    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119360    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119362    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119365    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119369    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119371    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119374    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119376    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119380    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119383    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119385    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119388    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119391    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119395    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119398    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119401    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119404    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119407    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119409    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 23:11:09.200485 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119412    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119416    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119419    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119421    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119423    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119427    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119430    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119433    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119436    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119439    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119442    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119444    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119447    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119450    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119453    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119455    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119459    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119462    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119465    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119467    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 23:11:09.201093 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119471    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119474    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119478    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119483    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119486    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119489    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119494    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119498    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119501    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119504    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119508    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119511    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119514    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119518    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119522    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.119524    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119607    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119616    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119624    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119628    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 23:11:09.203029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119633    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119637    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119643    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119648    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119651    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119658    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119662    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119667    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119671    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119674    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119678    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119682    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119685    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119689    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119695    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119698    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119702    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119706    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119709    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119714    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119717    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119721    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119726    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119730    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 23:11:09.203682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119733    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119736    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119741    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119744    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119749    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119753    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119756    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119759    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119763    2581 flags.go:64] FLAG: --enable-server="true"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119766    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119770    2581 flags.go:64] FLAG: --event-burst="100"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119774    2581 flags.go:64] FLAG: --event-qps="50"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119777    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119782    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119786    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119791    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119794    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119798    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119801    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119804    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119808    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119812    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119815    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119817    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119822    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 23:11:09.205590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119825    2581 flags.go:64] FLAG: --feature-gates=""
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119829    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119833    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119836    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119839    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119844    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119847    2581 flags.go:64] FLAG: --help="false"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119850    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119854    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119857    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119860    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119863    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119867    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119869    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119872    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119876    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119879    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119883    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119887    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119891    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119896    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119900    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119903    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119909    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 23:11:09.206436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119913    2581 flags.go:64] FLAG: --lock-file=""
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119915    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119918    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119922    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119928    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119931    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119935    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119938    2581 flags.go:64] FLAG: --logging-format="text"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119941    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119945    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119949    2581 flags.go:64] FLAG: --manifest-url=""
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119952    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119958    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119962    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119966    2581 flags.go:64] FLAG: --max-pods="110"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119970    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119973    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119976    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119980    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119984    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119987    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119990    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.119999    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120002    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120006    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 23:11:09.209411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120009    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120012    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120020    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120023    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120028    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120032    2581 flags.go:64] FLAG: --port="10250"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120036    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120040    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fe3ce1fac6548831"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120044    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120047    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120050    2581 flags.go:64] FLAG: --register-node="true"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120055    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120058    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120063    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120066    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120068    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120072    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120076    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120079    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120081    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120085    2581 flags.go:64] FLAG: --runonce="false"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120088    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120091    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120109    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120113    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 23:11:09.210250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120118    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120122    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120126    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120130    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120134    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120137    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120140    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120144    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120147    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120150    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120154    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120162    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120166    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120170    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120175    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120179    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120183    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120185    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120190    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120193    2581 flags.go:64] FLAG: --v="2"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120197    2581 flags.go:64] FLAG: --version="false"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120202    2581 flags.go:64] FLAG: --vmodule=""
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120206    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.120209    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120332    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 23:11:09.213056 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120335    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120340    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120343    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120346    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120348    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120353    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120355    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120357    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120360    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120364    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120366    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120370    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120372    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120375    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120378    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120381    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120383    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120387    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120391    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120394    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 23:11:09.213893 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120399    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120402    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120405    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120409    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120413    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120416    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120418    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120422    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120425    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120428    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120431    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120434    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120437    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120440    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120443    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120446    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120449    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120452    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120454    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 23:11:09.216108 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120458    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120463    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120466    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120471    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120474    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120477    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120481    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120483    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120486    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120489    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120492    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120496    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120499    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120504    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120507    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120509    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120513    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120518    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120520    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120523    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 23:11:09.216759 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120526    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120529    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120531    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120534    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120538    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120541    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120543    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120546    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120550    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120552    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120555    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120557    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120561    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120564    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120566    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120569    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120573    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120575    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120579    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 23:11:09.218724 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120583    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120587    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120589    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120592    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120597    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120600    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120608    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120611    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120615    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120620    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120623    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120627    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120630    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120634    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120637    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120640    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120644    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120647    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120649    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 23:11:09.219369 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.120652    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.121214    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.132460    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.132472    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.132484    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.132493    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132549    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132553    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132557    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132560    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132562    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132565    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132568    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132570    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 23:11:09.221962 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132573    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132576    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132579    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132582    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132584    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132587    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132589    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132593    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132597    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132600    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132604    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132606    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132609    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132612    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132615    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132618    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132620    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132623    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132625    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132628    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 23:11:09.222812 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132631    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132634    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132637    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132640    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132642    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132646    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132651    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132654    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132658    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132661    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132664    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132666    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132669    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132672    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132675    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132677    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132680    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132683    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132686    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132688    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 23:11:09.288440 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132691    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 23:11:09.223809 ip-10-0-137-221 systemd[1]: Started Kubernetes Kubelet.
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132694    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132697    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132700    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132703    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132706    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132709    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132711    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132714    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132717    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132719    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132721    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132724    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132727    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132730    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132732    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132735    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132737    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132740    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132742    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 23:11:09.289604 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132745    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132747    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132750    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132752    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132754    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132757    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132759    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132762    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132765    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132767    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132770    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132772    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132775    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132777    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132780    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132782    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132785    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132788    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132790    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132793    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 23:11:09.290411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132795    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132798    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132800    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132803    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132805    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132808    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132810    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132814    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132817    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132820    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132822    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.132827    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132933    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132937    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132940    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 23:11:09.293217 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132943    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132946    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132948    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132951    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132953    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132956    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132958    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132961    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132963    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132967    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132971    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132974    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132976    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132979    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132982    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132985    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132988    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132991    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132993    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132996    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 23:11:09.293833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.132999    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133002    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133004    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133007    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133009    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133012    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133014    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133017    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133019    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133022    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133024    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133026    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133029    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133031    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133034    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133036    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133039    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133041    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133043    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133046    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 23:11:09.294459 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133048    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133051    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133053    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133056    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133058    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133061    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133064    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133066    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133069    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133071    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133074    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133077    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133081    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133084    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133087    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133090    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133092    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133095    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133111    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 23:11:09.296175 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133113    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133116    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133118    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133121    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133123    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133126    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133129    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133131    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133134    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133137    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133139    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133142    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133144    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133147    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133149    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133152    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133154    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133157    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133159    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133162    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 23:11:09.296803 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133165    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133168    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133170    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133173    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133175    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133178    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133180    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133183    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133186    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133188    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133191    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133194    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133198    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133200    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133203    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133206    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 23:11:09.298920 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:09.133208    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.133213    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.133304    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.135203    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.136501    2581 server.go:1019] "Starting client certificate rotation"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.136594    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.136630    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.142485    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.175812    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.188899    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.190974    2581 log.go:25] "Validated CRI v1 image API"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.191778    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 23:11:09.299573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.196587    2581 fs.go:135] Filesystem UUIDs: map[37b8e7c8-ec35-4d79-880d-241f920816c5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f3cf98fd-8b82-4cdd-8cd0-77a53a1fc5cf:/dev/nvme0n1p3]
Jul 07 23:11:09.372775 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.196602    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.203033    2581 manager.go:216] Machine: {Timestamp:2026-07-07 23:11:09.201654213 +0000 UTC m=+0.421638293 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109614 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2790867b4d7aec317c2849572a0dec SystemUUID:ec279086-7b4d-7aec-317c-2849572a0dec BootID:c738a78c-9131-4b6e-9dbf-dd0787ad7e1e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8b:8f:89:6b:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8b:8f:89:6b:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:09:00:ae:c0:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.203140    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.203235    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.205649    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.205675    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.206461    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.206470    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 23:11:09.373537 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.206477    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.207840    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.208978    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.211976    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.212080    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.212703    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.212718    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.212732    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.212740    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.212749    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.213042    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.213056    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.215212    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.217275    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.217305    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218441    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218454    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218460    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218466    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218477    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218485    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218494    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218501    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218518    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218524    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218533    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.218541    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.220026    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.220034    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.223045    2581 server.go:1268] "Started kubelet"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.223143    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.223413    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.223488    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.226606    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.226936    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.227355    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.227539    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 23:11:09.378785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.228753    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.232304    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-221.ec2.internal.18c024c244124c12  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-221.ec2.internal,UID:ip-10-0-137-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-221.ec2.internal,},FirstTimestamp:2026-07-07 23:11:09.223021586 +0000 UTC m=+0.443005665,LastTimestamp:2026-07-07 23:11:09.223021586 +0000 UTC m=+0.443005665,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-221.ec2.internal,}"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.236493    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.236505    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.236606    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.237067    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.237069    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.237082    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.237157    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.237169    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.254874    2581 factory.go:55] Registering systemd factory
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.254887    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.255114    2581 factory.go:153] Registering CRI-O factory
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.255131    2581 factory.go:223] Registration of the crio container factory successfully
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.255181    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.255204    2581 factory.go:103] Registering Raw factory
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.255218    2581 manager.go:1196] Started watching for new ooms in manager
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.255590    2581 manager.go:349] Starting recovery of all containers
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.257454    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.261638    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.263240    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.263284    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.265975    2581 manager.go:354] Recovery completed
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.270443    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.272653    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.272674    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.272685    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientPID"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.273212    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.273223    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.273238    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.274444    2581 policy_none.go:49] "None policy: Start"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.274457    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.274467    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 23:11:09.380109 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.326634    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.326845    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-clzxg"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.326863    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-clzxg"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.326984    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-221.ec2.internal.18c024c24707cb6e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-221.ec2.internal,UID:ip-10-0-137-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-221.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-221.ec2.internal,},FirstTimestamp:2026-07-07 23:11:09.272664942 +0000 UTC m=+0.492649022,LastTimestamp:2026-07-07 23:11:09.272664942 +0000 UTC m=+0.492649022,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-221.ec2.internal,}"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.327824    2581 policy_none.go:47] "Start"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.328647    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.328676    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.328715    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientPID"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.336718    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.366926    2581 manager.go:337] "Starting Device Plugin manager"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.367162    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.367178    2581 server.go:87] "Starting device plugin registration server"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.367424    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.367437    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.367570    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.367659    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.367667    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.368220    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 23:11:09.381455 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.368280    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.467584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.467568    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 23:11:09.475108 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.468574    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 23:11:09.475108 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.468605    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 23:11:09.475108 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.468624    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientPID"
Jul 07 23:11:09.475108 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.468654    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.475108 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.470683    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-221.ec2.internal\" not found" node="ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.478282 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.478260    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.478282 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.478285    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-221.ec2.internal\": node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.494595 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.494571    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 23:11:09.495844 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.495825    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 23:11:09.495922 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.495861    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 23:11:09.495922 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.495883    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 23:11:09.495922 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.495913    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 23:11:09.497790 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.497772    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 23:11:09.499278 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.499252    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.600236 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.600204    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.600236 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.600226    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal"]
Jul 07 23:11:09.600374 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.600303    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 23:11:09.601142 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.601126    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 23:11:09.601250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.601182    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 23:11:09.601250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.601200    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientPID"
Jul 07 23:11:09.602605 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.602590    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 23:11:09.602734 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.602718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.602785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.602749    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 23:11:09.603356 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.603333    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 23:11:09.603445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.603368    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 23:11:09.603445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.603378    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientPID"
Jul 07 23:11:09.603445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.603337    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 23:11:09.603612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.603457    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 23:11:09.603612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.603472    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientPID"
Jul 07 23:11:09.604985 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.604968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.605031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.605004    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 23:11:09.605722 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.605706    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 23:11:09.605798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.605736    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 23:11:09.605798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.605750    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeHasSufficientPID"
Jul 07 23:11:09.627885 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.627861    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-221.ec2.internal\" not found" node="ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.632563 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.632545    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-221.ec2.internal\" not found" node="ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.640330 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.640313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82485c8841ab5eae08901d62bd2bc440-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal\" (UID: \"82485c8841ab5eae08901d62bd2bc440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.640411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.640337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bbdb5085a3e8dfea100c8d181fc213b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-221.ec2.internal\" (UID: \"7bbdb5085a3e8dfea100c8d181fc213b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.640411 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.640355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82485c8841ab5eae08901d62bd2bc440-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal\" (UID: \"82485c8841ab5eae08901d62bd2bc440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.701213 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.701193    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.740497 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.740431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82485c8841ab5eae08901d62bd2bc440-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal\" (UID: \"82485c8841ab5eae08901d62bd2bc440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.740580 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.740501    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82485c8841ab5eae08901d62bd2bc440-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal\" (UID: \"82485c8841ab5eae08901d62bd2bc440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.740580 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.740530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bbdb5085a3e8dfea100c8d181fc213b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-221.ec2.internal\" (UID: \"7bbdb5085a3e8dfea100c8d181fc213b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.740580 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.740551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82485c8841ab5eae08901d62bd2bc440-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal\" (UID: \"82485c8841ab5eae08901d62bd2bc440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.740687 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.740592    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82485c8841ab5eae08901d62bd2bc440-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal\" (UID: \"82485c8841ab5eae08901d62bd2bc440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.740687 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.740630    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bbdb5085a3e8dfea100c8d181fc213b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-221.ec2.internal\" (UID: \"7bbdb5085a3e8dfea100c8d181fc213b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.805559 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.805518    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.908752 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:09.908702    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:09.931571 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.931545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:09.936027 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:09.935837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:10.010265 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.010179    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.110864 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.110833    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.136996 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.136963    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 23:11:10.137450 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.137106    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 23:11:10.214376 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.214333    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.317867 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.317776    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.329881 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.329849    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 23:06:09 +0000 UTC" deadline="2028-03-11 07:10:03.421445181 +0000 UTC"
Jul 07 23:11:10.329881 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.329879    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14695h58m53.091569811s"
Jul 07 23:11:10.418807 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.418774    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.502000 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.501974    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 23:11:10.519192 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.519150    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.549408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.549382    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 23:11:10.620065 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.620020    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.628317 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:10.628282    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82485c8841ab5eae08901d62bd2bc440.slice/crio-fce7646b491832fbf6e19ec057b764e318800455a21666ab458dbe3a9339d8ce WatchSource:0}: Error finding container fce7646b491832fbf6e19ec057b764e318800455a21666ab458dbe3a9339d8ce: Status 404 returned error can't find the container with id fce7646b491832fbf6e19ec057b764e318800455a21666ab458dbe3a9339d8ce
Jul 07 23:11:10.628978 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:10.628957    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbdb5085a3e8dfea100c8d181fc213b.slice/crio-f607796696828a985845f4b385e13a6d26a51e0c617123fd3012254c2e34d073 WatchSource:0}: Error finding container f607796696828a985845f4b385e13a6d26a51e0c617123fd3012254c2e34d073: Status 404 returned error can't find the container with id f607796696828a985845f4b385e13a6d26a51e0c617123fd3012254c2e34d073
Jul 07 23:11:10.633071 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.633056    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 23:11:10.720988 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:10.720951    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-221.ec2.internal\" not found"
Jul 07 23:11:10.741634 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.741613    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 23:11:10.837296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.837263    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:10.848357 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.848334    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 23:11:10.849361 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.849348    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal"
Jul 07 23:11:10.863189 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:10.863172    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 23:11:11.218381 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.218352    2581 apiserver.go:52] "Watching apiserver"
Jul 07 23:11:11.227584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.227556    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 23:11:11.227936 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.227915    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-frvk2","kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5","openshift-dns/node-resolver-7j978","openshift-image-registry/node-ca-gpv7s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal","openshift-multus/multus-4sdmq","openshift-multus/multus-additional-cni-plugins-bjztw","kube-system/konnectivity-agent-q87nj","openshift-cluster-node-tuning-operator/tuned-wlvpv","openshift-multus/network-metrics-daemon-mlfz4","openshift-network-diagnostics/network-check-target-pbj79","openshift-network-operator/iptables-alerter-z4zdc","openshift-ovn-kubernetes/ovnkube-node-lxh4z"]
Jul 07 23:11:11.230445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.230429    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.231768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.231746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.233246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.233229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.234510 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.234491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.235199 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 23:11:11.235289 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235204    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 23:11:11.235523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235490    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 23:11:11.235523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235502    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 23:11:11.235661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235572    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 23:11:11.235661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235496    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 23:11:11.235661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cvsvm\""
Jul 07 23:11:11.236003 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.235982    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.236248 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.236227    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 23:11:11.236396 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.236369    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 23:11:11.236503 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.236409    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xblpv\""
Jul 07 23:11:11.236503 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.236429    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-srpxq\""
Jul 07 23:11:11.236691 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.236670    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 23:11:11.236792 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.236776    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 23:11:11.236960 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.236945    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 23:11:11.237283 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.237263    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 23:11:11.237359 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.237308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nrsrg\""
Jul 07 23:11:11.238074 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.237765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.238074 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.237896    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 23:11:11.238839 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.238781    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 23:11:11.239239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.239002    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 23:11:11.239239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.239072    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nnsqb\""
Jul 07 23:11:11.239239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.239126    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 23:11:11.239698 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.239681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.240114 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.240098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c4b8m\""
Jul 07 23:11:11.240527 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.240507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 23:11:11.240609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.240508    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 23:11:11.240657 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.240518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 23:11:11.241143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.241129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.241212 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.241151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 23:11:11.241212 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.241194    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:11.241841 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.241820    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 23:11:11.241949 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.241847    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 23:11:11.242368 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.242344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 23:11:11.242449 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.242403    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 23:11:11.242636 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.242621    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kxj2z\""
Jul 07 23:11:11.242816 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.242800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.245336 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.245315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 23:11:11.245502 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.245478    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 23:11:11.246025 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.245993    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2kx9s\""
Jul 07 23:11:11.246538 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.246515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.247964 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.247947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:11.248060 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.248022    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:11.249218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.249197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:11.249269 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.249256    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:11.250457 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-var-lib-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.250510 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-conf-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.250550 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/767be4b5-8947-47f0-8ee2-33f317e9fc30-host-slash\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.250584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nll5\" (UniqueName: \"kubernetes.io/projected/767be4b5-8947-47f0-8ee2-33f317e9fc30-kube-api-access-7nll5\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.250618 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.250618 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-hosts-file\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.250690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-tmp-dir\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.250752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.250752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-env-overrides\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.250752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-socket-dir-parent\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.250752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-cni-multus\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.250884 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-multus-certs\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.250884 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw9xg\" (UniqueName: \"kubernetes.io/projected/1302041d-2ead-42bf-9886-5dcad9d026a0-kube-api-access-qw9xg\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.250884 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xrgh\" (UniqueName: \"kubernetes.io/projected/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-kube-api-access-7xrgh\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.250884 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-kubelet\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.250884 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-etc-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.250884 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-log-socket\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.250884 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-registration-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-device-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-host\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovnkube-script-lib\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-kubelet\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-sys-fs\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-ovn\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.250999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-node-log\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c44516f3-0926-446d-a0fd-de3c3e71e567-cni-binary-copy\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-hostroot\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-daemon-config\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/767be4b5-8947-47f0-8ee2-33f317e9fc30-iptables-alerter-script\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.251136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-system-cni-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-slash\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251169    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-run-netns\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251183    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zxjlb\""
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-systemd\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-cni-netd\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovnkube-config\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovn-node-metrics-cert\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-netns\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqglk\" (UniqueName: \"kubernetes.io/projected/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-kube-api-access-gqglk\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-cni-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251448    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-serviceca\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxb4x\" (UniqueName: \"kubernetes.io/projected/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-kube-api-access-nxb4x\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.251728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-systemd-units\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-cni-bin\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-cnibin\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-os-release\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-k8s-cni-cncf-io\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-cni-bin\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-etc-kubernetes\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft48r\" (UniqueName: \"kubernetes.io/projected/c44516f3-0926-446d-a0fd-de3c3e71e567-kube-api-access-ft48r\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.252224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.251848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-socket-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.257267 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.257249    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 23:11:11.274965 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.274948    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rfjpk"
Jul 07 23:11:11.281974 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.281955    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rfjpk"
Jul 07 23:11:11.315864 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.315838    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 23:11:11.338397 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.338369    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 23:11:11.352580 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-host\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.352752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.352752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-sys-fs\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.352752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352704    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-host\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.353024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352749    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.353024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352813    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-sys-fs\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.353024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqx6\" (UniqueName: \"kubernetes.io/projected/bd5bf802-afe5-4a9e-88ac-764613fdd218-kube-api-access-2fqx6\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.353024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-ovn\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-node-log\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352990    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-ovn\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.352995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-hostroot\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/767be4b5-8947-47f0-8ee2-33f317e9fc30-iptables-alerter-script\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353040    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-hostroot\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fd79631-0b39-4e10-a8d3-2bcba019f02f-konnectivity-ca\") pod \"konnectivity-agent-q87nj\" (UID: \"1fd79631-0b39-4e10-a8d3-2bcba019f02f\") " pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-lib-modules\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35d855f9-8a54-477c-bcaf-f06a878e5696-tmp\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2c8\" (UniqueName: \"kubernetes.io/projected/35d855f9-8a54-477c-bcaf-f06a878e5696-kube-api-access-2n2c8\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353163    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-node-log\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-slash\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-run-netns\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-systemd\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353242    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-slash\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-cni-netd\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovnkube-config\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353320    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-run-netns\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.353383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-conf-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353323    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-systemd\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353366    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-cni-netd\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353412    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-conf-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/767be4b5-8947-47f0-8ee2-33f317e9fc30-host-slash\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353452    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/767be4b5-8947-47f0-8ee2-33f317e9fc30-host-slash\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nll5\" (UniqueName: \"kubernetes.io/projected/767be4b5-8947-47f0-8ee2-33f317e9fc30-kube-api-access-7nll5\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-serviceca\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-cni-bin\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353560    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-cni-bin\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-os-release\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-etc-kubernetes\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353706    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/767be4b5-8947-47f0-8ee2-33f317e9fc30-iptables-alerter-script\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353738    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-etc-kubernetes\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft48r\" (UniqueName: \"kubernetes.io/projected/c44516f3-0926-446d-a0fd-de3c3e71e567-kube-api-access-ft48r\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-tmp-dir\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd7ffe5a-2577-4511-99d8-79de623c8a52-kubelet-config\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-kubernetes\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-systemd\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-cni-multus\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.353991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-multus-certs\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovnkube-config\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354027    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-serviceca\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-kubelet\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354067    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-cni-multus\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-etc-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.354822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-multus-certs\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354098    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-tmp-dir\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354172    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-log-socket\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354107    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-kubelet\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-log-socket\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-device-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd7ffe5a-2577-4511-99d8-79de623c8a52-dbus\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354147    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-etc-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-cnibin\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysconfig\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354327    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-device-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-sys\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovnkube-script-lib\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-kubelet\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.355590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysctl-conf\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c44516f3-0926-446d-a0fd-de3c3e71e567-cni-binary-copy\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-daemon-config\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354478    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-kubelet\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysctl-d\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-system-cni-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovn-node-metrics-cert\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-netns\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-hosts-file\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-modprobe-d\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqglk\" (UniqueName: \"kubernetes.io/projected/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-kube-api-access-gqglk\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-cni-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxb4x\" (UniqueName: \"kubernetes.io/projected/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-kube-api-access-nxb4x\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.356235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-systemd-units\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-cnibin\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-k8s-cni-cncf-io\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-socket-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-os-release\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-cni-bin\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.354999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-run\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-var-lib-kubelet\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355033    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-daemon-config\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-host\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355074    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c44516f3-0926-446d-a0fd-de3c3e71e567-cni-binary-copy\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.356832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355108    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355202    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-hosts-file\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355272    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-cnibin\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355335    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-k8s-cni-cncf-io\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355436    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-socket-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355553    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355629    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-os-release\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355682    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovnkube-script-lib\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355734    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-system-cni-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355769    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-run-netns\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355757    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355811    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-systemd-units\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355826    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-cni-dir\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-tuned\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355875    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-host-var-lib-cni-bin\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.357490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-var-lib-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355971    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-run-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.355978    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-var-lib-openvswitch\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-env-overrides\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-socket-dir-parent\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356104    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c44516f3-0926-446d-a0fd-de3c3e71e567-multus-socket-dir-parent\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw9xg\" (UniqueName: \"kubernetes.io/projected/1302041d-2ead-42bf-9886-5dcad9d026a0-kube-api-access-qw9xg\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xrgh\" (UniqueName: \"kubernetes.io/projected/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-kube-api-access-7xrgh\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5m7b\" (UniqueName: \"kubernetes.io/projected/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-kube-api-access-c5m7b\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356252    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-registration-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356306    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1302041d-2ead-42bf-9886-5dcad9d026a0-registration-dir\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.358070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-system-cni-dir\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.358774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.358774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.358774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fd79631-0b39-4e10-a8d3-2bcba019f02f-agent-certs\") pod \"konnectivity-agent-q87nj\" (UID: \"1fd79631-0b39-4e10-a8d3-2bcba019f02f\") " pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.358774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.356518    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-env-overrides\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.359931 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.359875    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-ovn-node-metrics-cert\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.363390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.363087    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft48r\" (UniqueName: \"kubernetes.io/projected/c44516f3-0926-446d-a0fd-de3c3e71e567-kube-api-access-ft48r\") pod \"multus-4sdmq\" (UID: \"c44516f3-0926-446d-a0fd-de3c3e71e567\") " pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.364005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.363982    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nll5\" (UniqueName: \"kubernetes.io/projected/767be4b5-8947-47f0-8ee2-33f317e9fc30-kube-api-access-7nll5\") pod \"iptables-alerter-z4zdc\" (UID: \"767be4b5-8947-47f0-8ee2-33f317e9fc30\") " pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.364325 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.364298    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqglk\" (UniqueName: \"kubernetes.io/projected/6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88-kube-api-access-gqglk\") pod \"ovnkube-node-lxh4z\" (UID: \"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.365146 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.365124    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xrgh\" (UniqueName: \"kubernetes.io/projected/0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac-kube-api-access-7xrgh\") pod \"node-resolver-7j978\" (UID: \"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac\") " pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.366115 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.366090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxb4x\" (UniqueName: \"kubernetes.io/projected/5cd5bfae-3ca7-42df-8dcf-0c8a409818ed-kube-api-access-nxb4x\") pod \"node-ca-gpv7s\" (UID: \"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed\") " pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.372905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.372875    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw9xg\" (UniqueName: \"kubernetes.io/projected/1302041d-2ead-42bf-9886-5dcad9d026a0-kube-api-access-qw9xg\") pod \"aws-ebs-csi-driver-node-h8gp5\" (UID: \"1302041d-2ead-42bf-9886-5dcad9d026a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.457187 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-run\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.457187 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-var-lib-kubelet\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-host\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-tuned\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5m7b\" (UniqueName: \"kubernetes.io/projected/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-kube-api-access-c5m7b\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457280    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-run\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-var-lib-kubelet\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-system-cni-dir\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fd79631-0b39-4e10-a8d3-2bcba019f02f-agent-certs\") pod \"konnectivity-agent-q87nj\" (UID: \"1fd79631-0b39-4e10-a8d3-2bcba019f02f\") " pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.457494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqx6\" (UniqueName: \"kubernetes.io/projected/bd5bf802-afe5-4a9e-88ac-764613fdd218-kube-api-access-2fqx6\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fd79631-0b39-4e10-a8d3-2bcba019f02f-konnectivity-ca\") pod \"konnectivity-agent-q87nj\" (UID: \"1fd79631-0b39-4e10-a8d3-2bcba019f02f\") " pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-lib-modules\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457579    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-system-cni-dir\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35d855f9-8a54-477c-bcaf-f06a878e5696-tmp\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2c8\" (UniqueName: \"kubernetes.io/projected/35d855f9-8a54-477c-bcaf-f06a878e5696-kube-api-access-2n2c8\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-os-release\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd7ffe5a-2577-4511-99d8-79de623c8a52-kubelet-config\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-kubernetes\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-systemd\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd7ffe5a-2577-4511-99d8-79de623c8a52-dbus\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.458044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-cnibin\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysconfig\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-sys\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457930    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-host\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysctl-conf\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.457997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysctl-d\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.458031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-modprobe-d\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.458057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.458211    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.458227    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.458299    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs podName:daf750d5-c5fc-4b4d-a9b9-8933bbdf9008 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:11.958265429 +0000 UTC m=+3.178249513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs") pod "network-metrics-daemon-mlfz4" (UID: "daf750d5-c5fc-4b4d-a9b9-8933bbdf9008") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.458320    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret podName:dd7ffe5a-2577-4511-99d8-79de623c8a52 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:11.958309442 +0000 UTC m=+3.178293511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret") pod "global-pull-secret-syncer-frvk2" (UID: "dd7ffe5a-2577-4511-99d8-79de623c8a52") : object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.458317    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-os-release\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.458459    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysctl-d\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.458760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.458541    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-modprobe-d\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.458842    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.458942    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd7ffe5a-2577-4511-99d8-79de623c8a52-kubelet-config\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459103    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459161    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-kubernetes\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459235    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-systemd\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459292    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd7ffe5a-2577-4511-99d8-79de623c8a52-dbus\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459330    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd5bf802-afe5-4a9e-88ac-764613fdd218-cnibin\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459398    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-lib-modules\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459401    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysconfig\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459399    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459413    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fd79631-0b39-4e10-a8d3-2bcba019f02f-konnectivity-ca\") pod \"konnectivity-agent-q87nj\" (UID: \"1fd79631-0b39-4e10-a8d3-2bcba019f02f\") " pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459475    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-sys\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.459557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459553    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-sysctl-conf\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.460224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.459845    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd5bf802-afe5-4a9e-88ac-764613fdd218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.460224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.460018    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35d855f9-8a54-477c-bcaf-f06a878e5696-etc-tuned\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.461681 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.461654    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fd79631-0b39-4e10-a8d3-2bcba019f02f-agent-certs\") pod \"konnectivity-agent-q87nj\" (UID: \"1fd79631-0b39-4e10-a8d3-2bcba019f02f\") " pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.462617 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.462596    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35d855f9-8a54-477c-bcaf-f06a878e5696-tmp\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.463069 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.463049    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 23:11:11.463196 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.463079    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 23:11:11.463196 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.463094    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ck9zl for pod openshift-network-diagnostics/network-check-target-pbj79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:11.463325 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.463208    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl podName:9b541648-d620-47c0-bd51-1e7d61c20366 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:11.963191701 +0000 UTC m=+3.183175784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ck9zl" (UniqueName: "kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl") pod "network-check-target-pbj79" (UID: "9b541648-d620-47c0-bd51-1e7d61c20366") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:11.470256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.470185    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2c8\" (UniqueName: \"kubernetes.io/projected/35d855f9-8a54-477c-bcaf-f06a878e5696-kube-api-access-2n2c8\") pod \"tuned-wlvpv\" (UID: \"35d855f9-8a54-477c-bcaf-f06a878e5696\") " pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.471513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.471490    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5m7b\" (UniqueName: \"kubernetes.io/projected/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-kube-api-access-c5m7b\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:11.471612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.471574    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqx6\" (UniqueName: \"kubernetes.io/projected/bd5bf802-afe5-4a9e-88ac-764613fdd218-kube-api-access-2fqx6\") pod \"multus-additional-cni-plugins-bjztw\" (UID: \"bd5bf802-afe5-4a9e-88ac-764613fdd218\") " pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.502388 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.502294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal" event={"ID":"82485c8841ab5eae08901d62bd2bc440","Type":"ContainerStarted","Data":"fce7646b491832fbf6e19ec057b764e318800455a21666ab458dbe3a9339d8ce"}
Jul 07 23:11:11.503768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.503730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal" event={"ID":"7bbdb5085a3e8dfea100c8d181fc213b","Type":"ContainerStarted","Data":"f607796696828a985845f4b385e13a6d26a51e0c617123fd3012254c2e34d073"}
Jul 07 23:11:11.542526 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.542307    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4sdmq"
Jul 07 23:11:11.550124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.550098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4zdc"
Jul 07 23:11:11.554429 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.554395    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44516f3_0926_446d_a0fd_de3c3e71e567.slice/crio-0949d23a3fd683d99976b6b342a42876f1a3204d55b8b036ed99386b1c2af4eb WatchSource:0}: Error finding container 0949d23a3fd683d99976b6b342a42876f1a3204d55b8b036ed99386b1c2af4eb: Status 404 returned error can't find the container with id 0949d23a3fd683d99976b6b342a42876f1a3204d55b8b036ed99386b1c2af4eb
Jul 07 23:11:11.558581 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.558379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5"
Jul 07 23:11:11.561211 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.561161    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767be4b5_8947_47f0_8ee2_33f317e9fc30.slice/crio-06c0ca897b3a17112c824c60e8cec2af7c762948cb0dc21a4f439fc6aafe4539 WatchSource:0}: Error finding container 06c0ca897b3a17112c824c60e8cec2af7c762948cb0dc21a4f439fc6aafe4539: Status 404 returned error can't find the container with id 06c0ca897b3a17112c824c60e8cec2af7c762948cb0dc21a4f439fc6aafe4539
Jul 07 23:11:11.562429 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.562270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7j978"
Jul 07 23:11:11.568663 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.568448    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gpv7s"
Jul 07 23:11:11.571358 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.571310    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1302041d_2ead_42bf_9886_5dcad9d026a0.slice/crio-c597504cb903230f613fb0e810e35addfb15013dffaf475a02c7037515447106 WatchSource:0}: Error finding container c597504cb903230f613fb0e810e35addfb15013dffaf475a02c7037515447106: Status 404 returned error can't find the container with id c597504cb903230f613fb0e810e35addfb15013dffaf475a02c7037515447106
Jul 07 23:11:11.573941 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.573568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:11.574181 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.574157    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd94d7c_e1ae_4155_bd6d_60504cf4c0ac.slice/crio-a0be26b52ea788acae4b381ac5b6cae265aec3702a584b2f6912fcb3c540ae4f WatchSource:0}: Error finding container a0be26b52ea788acae4b381ac5b6cae265aec3702a584b2f6912fcb3c540ae4f: Status 404 returned error can't find the container with id a0be26b52ea788acae4b381ac5b6cae265aec3702a584b2f6912fcb3c540ae4f
Jul 07 23:11:11.579833 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.579803    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd5bfae_3ca7_42df_8dcf_0c8a409818ed.slice/crio-a279e081522a0fcf3f248b23c5a330bcd0ef90c3134067c32fc0e758099aac3d WatchSource:0}: Error finding container a279e081522a0fcf3f248b23c5a330bcd0ef90c3134067c32fc0e758099aac3d: Status 404 returned error can't find the container with id a279e081522a0fcf3f248b23c5a330bcd0ef90c3134067c32fc0e758099aac3d
Jul 07 23:11:11.580785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.580711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:11.586453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.586428    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bjztw"
Jul 07 23:11:11.588595 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.588568    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd06347_bd8c_42c5_b4e6_a1aeac9e2b88.slice/crio-7ce0b963e88103f62dcf551e793de8eee003dc3753d82efc07f2858785168173 WatchSource:0}: Error finding container 7ce0b963e88103f62dcf551e793de8eee003dc3753d82efc07f2858785168173: Status 404 returned error can't find the container with id 7ce0b963e88103f62dcf551e793de8eee003dc3753d82efc07f2858785168173
Jul 07 23:11:11.591276 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.591257    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wlvpv"
Jul 07 23:11:11.592771 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.592748    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd79631_0b39_4e10_a8d3_2bcba019f02f.slice/crio-dec05a0a4dfc37b5a210c03c9557f5c49a26056601ababa8d365c948888c7c65 WatchSource:0}: Error finding container dec05a0a4dfc37b5a210c03c9557f5c49a26056601ababa8d365c948888c7c65: Status 404 returned error can't find the container with id dec05a0a4dfc37b5a210c03c9557f5c49a26056601ababa8d365c948888c7c65
Jul 07 23:11:11.602581 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.602547    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5bf802_afe5_4a9e_88ac_764613fdd218.slice/crio-93bfdc2f38d7dfe98fcd12892dff5ceed4b875129988251126db3dedcc40246a WatchSource:0}: Error finding container 93bfdc2f38d7dfe98fcd12892dff5ceed4b875129988251126db3dedcc40246a: Status 404 returned error can't find the container with id 93bfdc2f38d7dfe98fcd12892dff5ceed4b875129988251126db3dedcc40246a
Jul 07 23:11:11.606451 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:11.606423    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d855f9_8a54_477c_bcaf_f06a878e5696.slice/crio-c9d19854e1d2e90a94ef6f6b92e43057bc408040671d12e54c85806d4a542db7 WatchSource:0}: Error finding container c9d19854e1d2e90a94ef6f6b92e43057bc408040671d12e54c85806d4a542db7: Status 404 returned error can't find the container with id c9d19854e1d2e90a94ef6f6b92e43057bc408040671d12e54c85806d4a542db7
Jul 07 23:11:11.961986 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.961942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:11.962235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:11.962065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:11.962326 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.962305    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:11.964199 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.962391    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs podName:daf750d5-c5fc-4b4d-a9b9-8933bbdf9008 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:12.962369551 +0000 UTC m=+4.182353633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs") pod "network-metrics-daemon-mlfz4" (UID: "daf750d5-c5fc-4b4d-a9b9-8933bbdf9008") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:11.964199 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.962500    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:11.964199 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:11.962572    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret podName:dd7ffe5a-2577-4511-99d8-79de623c8a52 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:12.962553886 +0000 UTC m=+4.182537954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret") pod "global-pull-secret-syncer-frvk2" (UID: "dd7ffe5a-2577-4511-99d8-79de623c8a52") : object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:12.063388 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.063332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:12.063618 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.063555    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 23:11:12.063618 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.063570    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 23:11:12.063618 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.063580    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ck9zl for pod openshift-network-diagnostics/network-check-target-pbj79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:12.063799 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.063624    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl podName:9b541648-d620-47c0-bd51-1e7d61c20366 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:13.063611297 +0000 UTC m=+4.283595365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck9zl" (UniqueName: "kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl") pod "network-check-target-pbj79" (UID: "9b541648-d620-47c0-bd51-1e7d61c20366") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:12.284380 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.284257    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 23:06:11 +0000 UTC" deadline="2028-03-27 17:01:14.551061422 +0000 UTC"
Jul 07 23:11:12.284380 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.284324    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15089h50m2.266741513s"
Jul 07 23:11:12.508213 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.508168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wlvpv" event={"ID":"35d855f9-8a54-477c-bcaf-f06a878e5696","Type":"ContainerStarted","Data":"c9d19854e1d2e90a94ef6f6b92e43057bc408040671d12e54c85806d4a542db7"}
Jul 07 23:11:12.510582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.510548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerStarted","Data":"93bfdc2f38d7dfe98fcd12892dff5ceed4b875129988251126db3dedcc40246a"}
Jul 07 23:11:12.514113 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.514083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q87nj" event={"ID":"1fd79631-0b39-4e10-a8d3-2bcba019f02f","Type":"ContainerStarted","Data":"dec05a0a4dfc37b5a210c03c9557f5c49a26056601ababa8d365c948888c7c65"}
Jul 07 23:11:12.516675 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.516645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gpv7s" event={"ID":"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed","Type":"ContainerStarted","Data":"a279e081522a0fcf3f248b23c5a330bcd0ef90c3134067c32fc0e758099aac3d"}
Jul 07 23:11:12.518716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.518640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7j978" event={"ID":"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac","Type":"ContainerStarted","Data":"a0be26b52ea788acae4b381ac5b6cae265aec3702a584b2f6912fcb3c540ae4f"}
Jul 07 23:11:12.520597 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.520487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"7ce0b963e88103f62dcf551e793de8eee003dc3753d82efc07f2858785168173"}
Jul 07 23:11:12.522806 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.522734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5" event={"ID":"1302041d-2ead-42bf-9886-5dcad9d026a0","Type":"ContainerStarted","Data":"c597504cb903230f613fb0e810e35addfb15013dffaf475a02c7037515447106"}
Jul 07 23:11:12.525561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.525483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4zdc" event={"ID":"767be4b5-8947-47f0-8ee2-33f317e9fc30","Type":"ContainerStarted","Data":"06c0ca897b3a17112c824c60e8cec2af7c762948cb0dc21a4f439fc6aafe4539"}
Jul 07 23:11:12.527887 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.527848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4sdmq" event={"ID":"c44516f3-0926-446d-a0fd-de3c3e71e567","Type":"ContainerStarted","Data":"0949d23a3fd683d99976b6b342a42876f1a3204d55b8b036ed99386b1c2af4eb"}
Jul 07 23:11:12.971280 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.971245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:12.971471 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:12.971342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:12.971537 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.971503    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:12.971596 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.971567    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret podName:dd7ffe5a-2577-4511-99d8-79de623c8a52 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:14.971549155 +0000 UTC m=+6.191533227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret") pod "global-pull-secret-syncer-frvk2" (UID: "dd7ffe5a-2577-4511-99d8-79de623c8a52") : object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:12.972258 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.972229    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:12.972362 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:12.972296    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs podName:daf750d5-c5fc-4b4d-a9b9-8933bbdf9008 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:14.972278653 +0000 UTC m=+6.192262723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs") pod "network-metrics-daemon-mlfz4" (UID: "daf750d5-c5fc-4b4d-a9b9-8933bbdf9008") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:13.072150 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:13.072083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:13.072333 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:13.072275    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 23:11:13.072333 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:13.072297    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 23:11:13.072333 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:13.072312    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ck9zl for pod openshift-network-diagnostics/network-check-target-pbj79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:13.072559 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:13.072376    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl podName:9b541648-d620-47c0-bd51-1e7d61c20366 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:15.072355613 +0000 UTC m=+6.292339686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck9zl" (UniqueName: "kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl") pod "network-check-target-pbj79" (UID: "9b541648-d620-47c0-bd51-1e7d61c20366") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:13.285140 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:13.285000    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 23:06:11 +0000 UTC" deadline="2028-03-01 19:09:56.193162895 +0000 UTC"
Jul 07 23:11:13.285140 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:13.285040    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14467h58m42.908127289s"
Jul 07 23:11:13.497310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:13.497279    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:13.497310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:13.497310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:13.497556 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:13.497420    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:13.497556 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:13.497468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:13.497682 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:13.497567    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:13.497682 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:13.497660    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:14.987984 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:14.987949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:14.988513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:14.988028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:14.988513 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:14.988184    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:14.988513 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:14.988243    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret podName:dd7ffe5a-2577-4511-99d8-79de623c8a52 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:18.988225139 +0000 UTC m=+10.208209214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret") pod "global-pull-secret-syncer-frvk2" (UID: "dd7ffe5a-2577-4511-99d8-79de623c8a52") : object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:14.988513 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:14.988289    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:14.988513 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:14.988363    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs podName:daf750d5-c5fc-4b4d-a9b9-8933bbdf9008 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:18.988335221 +0000 UTC m=+10.208319300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs") pod "network-metrics-daemon-mlfz4" (UID: "daf750d5-c5fc-4b4d-a9b9-8933bbdf9008") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:15.088391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:15.088353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:15.088586 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:15.088571    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 23:11:15.088661 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:15.088592    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 23:11:15.088661 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:15.088605    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ck9zl for pod openshift-network-diagnostics/network-check-target-pbj79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:15.088766 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:15.088661    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl podName:9b541648-d620-47c0-bd51-1e7d61c20366 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:19.08864327 +0000 UTC m=+10.308627353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck9zl" (UniqueName: "kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl") pod "network-check-target-pbj79" (UID: "9b541648-d620-47c0-bd51-1e7d61c20366") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:15.499161 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:15.499105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:15.499352 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:15.499263    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:15.499666 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:15.499644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:15.499786 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:15.499763    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:15.499846 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:15.499819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:15.499898 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:15.499884    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:17.503380 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:17.503338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:17.503380 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:17.503359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:17.503874 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:17.503339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:17.503874 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:17.503455    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:17.503874 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:17.503514    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:17.503874 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:17.503639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:19.022937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:19.022901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:19.023458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:19.022991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:19.023458 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.023082    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:19.023458 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.023114    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:19.023458 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.023172    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs podName:daf750d5-c5fc-4b4d-a9b9-8933bbdf9008 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:27.023151556 +0000 UTC m=+18.243135642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs") pod "network-metrics-daemon-mlfz4" (UID: "daf750d5-c5fc-4b4d-a9b9-8933bbdf9008") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:19.023458 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.023193    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret podName:dd7ffe5a-2577-4511-99d8-79de623c8a52 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:27.023183805 +0000 UTC m=+18.243167871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret") pod "global-pull-secret-syncer-frvk2" (UID: "dd7ffe5a-2577-4511-99d8-79de623c8a52") : object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:19.124259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:19.124209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:19.124413 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.124396    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 23:11:19.124452 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.124413    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 23:11:19.124452 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.124426    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ck9zl for pod openshift-network-diagnostics/network-check-target-pbj79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:19.124516 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.124492    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl podName:9b541648-d620-47c0-bd51-1e7d61c20366 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:27.124473522 +0000 UTC m=+18.344457608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck9zl" (UniqueName: "kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl") pod "network-check-target-pbj79" (UID: "9b541648-d620-47c0-bd51-1e7d61c20366") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:19.498529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:19.497953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:19.498529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:19.498010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:19.498529 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.498163    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:19.498529 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.498181    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:19.498529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:19.498229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:19.498529 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:19.498300    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:21.496697 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:21.496665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:21.497133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:21.496720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:21.497133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:21.496741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:21.497133 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:21.496815    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:21.497133 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:21.496924    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:21.497133 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:21.497025    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:23.496699 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:23.496613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:23.497114 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:23.496613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:23.497114 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:23.496733    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:23.497114 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:23.496769    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:23.497114 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:23.496889    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:23.497114 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:23.496991    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:25.496349 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:25.496317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:25.496788 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:25.496355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:25.496788 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:25.496327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:25.496788 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:25.496443    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:25.496788 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:25.496530    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:25.496788 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:25.496598    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:27.083092 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:27.083051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:27.083587 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:27.083141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:27.083587 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.083221    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:27.083587 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.083249    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:27.083587 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.083294    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs podName:daf750d5-c5fc-4b4d-a9b9-8933bbdf9008 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:43.083273178 +0000 UTC m=+34.303257258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs") pod "network-metrics-daemon-mlfz4" (UID: "daf750d5-c5fc-4b4d-a9b9-8933bbdf9008") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:27.083587 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.083316    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret podName:dd7ffe5a-2577-4511-99d8-79de623c8a52 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:43.083306333 +0000 UTC m=+34.303290405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret") pod "global-pull-secret-syncer-frvk2" (UID: "dd7ffe5a-2577-4511-99d8-79de623c8a52") : object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:27.184152 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:27.184118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:27.184328 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.184284    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 23:11:27.184328 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.184304    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 23:11:27.184328 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.184316    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ck9zl for pod openshift-network-diagnostics/network-check-target-pbj79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:27.184437 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.184372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl podName:9b541648-d620-47c0-bd51-1e7d61c20366 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:43.184353863 +0000 UTC m=+34.404337946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck9zl" (UniqueName: "kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl") pod "network-check-target-pbj79" (UID: "9b541648-d620-47c0-bd51-1e7d61c20366") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:27.497262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:27.496784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:27.497262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:27.496828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:27.497262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:27.496784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:27.497262 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.496925    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:27.497262 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.497058    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:27.497262 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:27.497154    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:29.497504 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:29.497467    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:29.497939 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:29.497562    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:29.497939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:29.497644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:29.497939 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:29.497768    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:29.497939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:29.497775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:29.497939 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:29.497876    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:31.497521 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.497034    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:31.497521 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.497329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:31.497521 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.497388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:31.498022 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:31.497545    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:31.498022 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:31.497689    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:31.498022 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:31.497785    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:31.581416 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.581013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"1ebb9f5f029e7f62bf84ed0e8c44e495fced4ded741d2cf4b52360769125f58d"}
Jul 07 23:11:31.581416 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.581333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"863998bdd471e7df263f02117bf72033655299d321ab2aa591e098483c1b354e"}
Jul 07 23:11:31.583757 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.583735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4sdmq" event={"ID":"c44516f3-0926-446d-a0fd-de3c3e71e567","Type":"ContainerStarted","Data":"e8052c6c6b224b0a0a9d78fc62c93d59fc256721b1ede8eb9c95c980f35ea9d4"}
Jul 07 23:11:31.585247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.585226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal" event={"ID":"7bbdb5085a3e8dfea100c8d181fc213b","Type":"ContainerStarted","Data":"5fce68e1db1dfdb6a855edeb8fe5c0b7c9a8ff5cae6d2b4a9cc23b34a8bc6b8c"}
Jul 07 23:11:31.587267 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.587242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wlvpv" event={"ID":"35d855f9-8a54-477c-bcaf-f06a878e5696","Type":"ContainerStarted","Data":"48a3a6bcaae4bc42a666ccbadcc97283b574ea62c03cd3d3655ce6c1751e3f38"}
Jul 07 23:11:31.601471 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.601380    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4sdmq" podStartSLOduration=1.810465306 podStartE2EDuration="21.601365245s" totalImagesPullingTime="19.790899939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:31.600140801 +0000 UTC m=+22.820124890" watchObservedRunningTime="2026-07-07 23:11:31.601365245 +0000 UTC m=+22.821349334"
Jul 07 23:11:31.628046 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.628001    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-221.ec2.internal" podStartSLOduration=20.62798518 podStartE2EDuration="20.62798518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:31.612281627 +0000 UTC m=+22.832265716" watchObservedRunningTime="2026-07-07 23:11:31.62798518 +0000 UTC m=+22.847969284"
Jul 07 23:11:31.628389 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:31.628366    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wlvpv" podStartSLOduration=1.943524639 podStartE2EDuration="21.62835984s" totalImagesPullingTime="19.684835201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:31.627850102 +0000 UTC m=+22.847834192" watchObservedRunningTime="2026-07-07 23:11:31.62835984 +0000 UTC m=+22.848343929"
Jul 07 23:11:32.591340 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.591227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q87nj" event={"ID":"1fd79631-0b39-4e10-a8d3-2bcba019f02f","Type":"ContainerStarted","Data":"56c13894360eaa5b044006168ac088d7c3cdd1086d43706ba9bbcc54252bdc67"}
Jul 07 23:11:32.592968 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.592931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gpv7s" event={"ID":"5cd5bfae-3ca7-42df-8dcf-0c8a409818ed","Type":"ContainerStarted","Data":"0c64247f98fb055abbd88f6940d5d077980d10ec4469b14d025889f42a2b6431"}
Jul 07 23:11:32.594310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.594286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7j978" event={"ID":"0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac","Type":"ContainerStarted","Data":"f30fff6d5229e8d1d2f302b950fc97bbd6db64a50a34efed8be6893f2e648b7a"}
Jul 07 23:11:32.597392 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.597369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"225b09dfa02b4ff4b998ca0f0dd0188df018e633106072ec2f2701d679791583"}
Jul 07 23:11:32.597500 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.597434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"133e1218419605626f8be74dfae3a1569e1ce9e893bb7aad9a64c117985f4e2e"}
Jul 07 23:11:32.597500 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.597485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"904ed015c2d134752855118c8920afa1e2731f1d50ad8c6a2dac77f8e2a6596e"}
Jul 07 23:11:32.597601 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.597534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"a9a3af1c1a7a42987b63b882468f0b66accf8e08d9ff828e9a5476ec72ea307e"}
Jul 07 23:11:32.598954 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.598936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5" event={"ID":"1302041d-2ead-42bf-9886-5dcad9d026a0","Type":"ContainerStarted","Data":"1a5bfb7def13033ad96292dda195a3240ce241f7a91c5d859ad8036e9abb9345"}
Jul 07 23:11:32.600461 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.600438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4zdc" event={"ID":"767be4b5-8947-47f0-8ee2-33f317e9fc30","Type":"ContainerStarted","Data":"e36f931ea7bfa9f0a9f8eb8d2ab7bad358bb7e699577ce7f853bc51c27e18064"}
Jul 07 23:11:32.602141 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.602118    2581 generic.go:356] "Generic (PLEG): container finished" podID="82485c8841ab5eae08901d62bd2bc440" containerID="c970887d8fdf5acd59625aae5fafb3ac824d29bf117250a56ca3f6f9a724a04b" exitCode=0
Jul 07 23:11:32.602226 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.602185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal" event={"ID":"82485c8841ab5eae08901d62bd2bc440","Type":"ContainerDied","Data":"c970887d8fdf5acd59625aae5fafb3ac824d29bf117250a56ca3f6f9a724a04b"}
Jul 07 23:11:32.603802 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.603781    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd5bf802-afe5-4a9e-88ac-764613fdd218" containerID="08bdeb42efc24843079fddc44e65dcc975853ee02573a0bb1ce5f4b6a5a7c70d" exitCode=0
Jul 07 23:11:32.603903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.603867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerDied","Data":"08bdeb42efc24843079fddc44e65dcc975853ee02573a0bb1ce5f4b6a5a7c70d"}
Jul 07 23:11:32.626525 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.626483    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q87nj" podStartSLOduration=2.924369649 podStartE2EDuration="22.626469505s" totalImagesPullingTime="19.702099856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:32.607495932 +0000 UTC m=+23.827480023" watchObservedRunningTime="2026-07-07 23:11:32.626469505 +0000 UTC m=+23.846453594"
Jul 07 23:11:32.627017 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.626990    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7j978" podStartSLOduration=11.43558731 podStartE2EDuration="22.626982483s" totalImagesPullingTime="11.191395173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:32.626290432 +0000 UTC m=+23.846274524" watchObservedRunningTime="2026-07-07 23:11:32.626982483 +0000 UTC m=+23.846966571"
Jul 07 23:11:32.676906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.676702    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gpv7s" podStartSLOduration=2.9653239559999998 podStartE2EDuration="22.676686053s" totalImagesPullingTime="19.711362097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:32.644080787 +0000 UTC m=+23.864064877" watchObservedRunningTime="2026-07-07 23:11:32.676686053 +0000 UTC m=+23.896670143"
Jul 07 23:11:32.711443 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:32.711401    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z4zdc" podStartSLOduration=12.082444981 podStartE2EDuration="22.711381436s" totalImagesPullingTime="10.628936455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:32.711089026 +0000 UTC m=+23.931073117" watchObservedRunningTime="2026-07-07 23:11:32.711381436 +0000 UTC m=+23.931365528"
Jul 07 23:11:33.489624 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:33.489495    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 23:11:33.496454 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:33.496365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:33.496454 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:33.496408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:33.496597 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:33.496486    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:33.496597 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:33.496524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:33.496597 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:33.496590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:33.496744 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:33.496725    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:33.608397 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:33.608323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5" event={"ID":"1302041d-2ead-42bf-9886-5dcad9d026a0","Type":"ContainerStarted","Data":"fa1170dabc7e7105d2d77d7c1311780597e957b906e5ee7c278556e6758e3a07"}
Jul 07 23:11:33.610252 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:33.610215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal" event={"ID":"82485c8841ab5eae08901d62bd2bc440","Type":"ContainerStarted","Data":"8a01c731a627e56473e4f17aece7a1f80e37b77df69184fde42a3ee7e4598d83"}
Jul 07 23:11:33.633299 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:33.633225    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-221.ec2.internal" podStartSLOduration=22.633212825 podStartE2EDuration="22.633212825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:33.633194687 +0000 UTC m=+24.853178780" watchObservedRunningTime="2026-07-07 23:11:33.633212825 +0000 UTC m=+24.853196914"
Jul 07 23:11:34.383661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:34.383554    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T23:11:33.489508997Z","UUID":"ffc57c54-b5e3-44f8-b2df-4ab25c523791","Handler":null,"Name":"","Endpoint":""}
Jul 07 23:11:34.385866 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:34.385840    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 23:11:34.386002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:34.385885    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 23:11:34.615970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:34.615939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"428e2b78382cd84acd88b692182288365a9849f0dd3b2294819c8ff25b5e2c5d"}
Jul 07 23:11:35.496905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:35.496874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:35.496905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:35.496893    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:35.497122 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:35.496983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:35.497122 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:35.497004    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:35.497122 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:35.497055    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:35.497225 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:35.497125    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:35.621130 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:35.621082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5" event={"ID":"1302041d-2ead-42bf-9886-5dcad9d026a0","Type":"ContainerStarted","Data":"8cdc734fbaea7aa326194efb46b3ec3410be6738086a2af8da3b72f68e41611d"}
Jul 07 23:11:35.639327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:35.639282    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8gp5" podStartSLOduration=3.263177412 podStartE2EDuration="25.639262724s" totalImagesPullingTime="22.376085312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:35.638746176 +0000 UTC m=+26.858730265" watchObservedRunningTime="2026-07-07 23:11:35.639262724 +0000 UTC m=+26.859246815"
Jul 07 23:11:36.626523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:36.626346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" event={"ID":"6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88","Type":"ContainerStarted","Data":"851bbdca7860816c9f1a955fdbb9c81aebeba146955a690ada9480840b2061e0"}
Jul 07 23:11:36.655979 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:36.655928    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z" podStartSLOduration=6.884467266 podStartE2EDuration="26.655913559s" totalImagesPullingTime="19.771446293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:36.654938223 +0000 UTC m=+27.874922312" watchObservedRunningTime="2026-07-07 23:11:36.655913559 +0000 UTC m=+27.875897648"
Jul 07 23:11:37.496302 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.496269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:37.496465 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:37.496387    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:37.496691 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.496677    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:37.496758 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:37.496747    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:37.496811 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.496785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:37.496865 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:37.496840    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:37.565284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.565248    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:37.565860 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.565839    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:37.629117 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.629070    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:37.629737 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.629177    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:37.629737 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.629209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:37.629737 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.629253    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:37.629737 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.629322    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q87nj"
Jul 07 23:11:37.644475 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.644446    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:37.644611 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:37.644581    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:11:38.470623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:38.470574    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-frvk2"]
Jul 07 23:11:38.470776 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:38.470740    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:38.470851 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:38.470825    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:38.471255 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:38.471236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mlfz4"]
Jul 07 23:11:38.471370 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:38.471338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:38.471448 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:38.471426    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:38.474365 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:38.474343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pbj79"]
Jul 07 23:11:38.474465 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:38.474426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:38.474520 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:38.474487    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:40.496425 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:40.496230    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:40.496945 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:40.496259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:40.496945 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:40.496497    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:40.496945 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:40.496290    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:40.496945 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:40.496573    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:40.496945 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:40.496641    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:40.636726 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:40.636691    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd5bf802-afe5-4a9e-88ac-764613fdd218" containerID="364376d9adee629a97ffc4ef5ac2d016083949e1a094f3857690f16a62559c45" exitCode=0
Jul 07 23:11:40.636888 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:40.636757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerDied","Data":"364376d9adee629a97ffc4ef5ac2d016083949e1a094f3857690f16a62559c45"}
Jul 07 23:11:41.641013 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:41.640984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerStarted","Data":"f2c832109a6a65158a2fe224eb06e46ae8123e42a38055f9ffb6849fd01b45bf"}
Jul 07 23:11:42.496609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:42.496576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:42.496774 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:42.496673    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:42.496774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:42.496586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:42.496774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:42.496707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:42.496872 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:42.496792    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:42.496872 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:42.496865    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:42.645240 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:42.645207    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd5bf802-afe5-4a9e-88ac-764613fdd218" containerID="f2c832109a6a65158a2fe224eb06e46ae8123e42a38055f9ffb6849fd01b45bf" exitCode=0
Jul 07 23:11:42.645619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:42.645253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerDied","Data":"f2c832109a6a65158a2fe224eb06e46ae8123e42a38055f9ffb6849fd01b45bf"}
Jul 07 23:11:43.104038 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:43.104001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:43.104214 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:43.104061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:43.104214 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.104162    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:43.104214 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.104165    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:43.104214 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.104213    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret podName:dd7ffe5a-2577-4511-99d8-79de623c8a52 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:15.104199445 +0000 UTC m=+66.324183512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret") pod "global-pull-secret-syncer-frvk2" (UID: "dd7ffe5a-2577-4511-99d8-79de623c8a52") : object "kube-system"/"original-pull-secret" not registered
Jul 07 23:11:43.104352 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.104226    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs podName:daf750d5-c5fc-4b4d-a9b9-8933bbdf9008 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:15.10421984 +0000 UTC m=+66.324203906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs") pod "network-metrics-daemon-mlfz4" (UID: "daf750d5-c5fc-4b4d-a9b9-8933bbdf9008") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 23:11:43.205258 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:43.205231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:43.205417 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.205360    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 23:11:43.205417 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.205374    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 23:11:43.205417 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.205383    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ck9zl for pod openshift-network-diagnostics/network-check-target-pbj79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:43.205508 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:43.205430    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl podName:9b541648-d620-47c0-bd51-1e7d61c20366 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:15.205417152 +0000 UTC m=+66.425401222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck9zl" (UniqueName: "kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl") pod "network-check-target-pbj79" (UID: "9b541648-d620-47c0-bd51-1e7d61c20366") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 23:11:43.650426 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:43.650400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerStarted","Data":"1b228fb8e356d7e633b377afe4edb3ddb605d60f8f2c431bcdaaa07ef6e16b3d"}
Jul 07 23:11:44.496754 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:44.496719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:44.496936 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:44.496720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:44.496936 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:44.496832    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlfz4" podUID="daf750d5-c5fc-4b4d-a9b9-8933bbdf9008"
Jul 07 23:11:44.496936 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:44.496719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:44.496936 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:44.496895    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbj79" podUID="9b541648-d620-47c0-bd51-1e7d61c20366"
Jul 07 23:11:44.497078 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:44.496956    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frvk2" podUID="dd7ffe5a-2577-4511-99d8-79de623c8a52"
Jul 07 23:11:44.654872 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:44.654840    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd5bf802-afe5-4a9e-88ac-764613fdd218" containerID="1b228fb8e356d7e633b377afe4edb3ddb605d60f8f2c431bcdaaa07ef6e16b3d" exitCode=0
Jul 07 23:11:44.654872 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:44.654877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerDied","Data":"1b228fb8e356d7e633b377afe4edb3ddb605d60f8f2c431bcdaaa07ef6e16b3d"}
Jul 07 23:11:45.079205 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.079129    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-221.ec2.internal" event="NodeReady"
Jul 07 23:11:45.079344 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.079250    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 23:11:45.119475 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.119443    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"]
Jul 07 23:11:45.121194 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.121178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:45.122847 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.122824    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"]
Jul 07 23:11:45.123526 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.123506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 23:11:45.123738 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.123726    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.124023 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.124008    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.124183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.124168    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nvxgx\""
Jul 07 23:11:45.124367 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.124352    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"]
Jul 07 23:11:45.124475 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.124461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"
Jul 07 23:11:45.125762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.125746    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-687b8d59fc-d8wzr"]
Jul 07 23:11:45.125868 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.125855    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.126657 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.126638    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.126742 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.126727    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.126899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.126879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-d68j8\""
Jul 07 23:11:45.127349 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.127334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.129286 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.128790    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.129286 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.128830    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.130052 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.130037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8m9kl\""
Jul 07 23:11:45.130150 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.130074    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 23:11:45.130814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.130796    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 23:11:45.130814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.130818    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 23:11:45.131010 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.130854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 23:11:45.131010 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.130891    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 23:11:45.131309 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.131294    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-76ckg\""
Jul 07 23:11:45.139736 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.139660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"]
Jul 07 23:11:45.141576 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.141553    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 23:11:45.141756 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.141630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"]
Jul 07 23:11:45.145086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.144715    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"]
Jul 07 23:11:45.146673 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.145525    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"]
Jul 07 23:11:45.149710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.149681    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vn985"]
Jul 07 23:11:45.150440 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.149822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.153078 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.153049    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"]
Jul 07 23:11:45.153320 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.153301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.153988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.153965    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 23:11:45.153988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.153985    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vlxcr\""
Jul 07 23:11:45.154157 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.154042    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.154217 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.154188    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 23:11:45.154319 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.154298    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.155860 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.155842    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"]
Jul 07 23:11:45.155976 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.155959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.156495 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.156476    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 23:11:45.156820 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.156805    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-78s5w\""
Jul 07 23:11:45.157946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.157895    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 23:11:45.158089 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.158071    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 23:11:45.158467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.158446    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 23:11:45.158552 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.158468    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-26rgc\""
Jul 07 23:11:45.159198 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.159162    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.159977 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.159957    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-57gv8"]
Jul 07 23:11:45.160698 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.160681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:45.163588 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.163565    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687b8d59fc-d8wzr"]
Jul 07 23:11:45.163588 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.163609    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d8c8946bf-skgkk"]
Jul 07 23:11:45.164306 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.164288    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 23:11:45.164982 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.164329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-22dhs\""
Jul 07 23:11:45.164982 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.164329    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.164982 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.164349    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 23:11:45.166596 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.166571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.168165 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.168144    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-ltgrj"]
Jul 07 23:11:45.168344 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.168329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.168967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.168950    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 23:11:45.169049 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.168992    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.169325 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.169274    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.169412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.169329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 23:11:45.169412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.169403    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fmdtr\""
Jul 07 23:11:45.170578 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.170558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 23:11:45.170879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.170862    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.171077 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.170897    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 23:11:45.171077 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.170905    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 23:11:45.171562 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.171544    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.172046 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.172025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lvl65\""
Jul 07 23:11:45.172297 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.172280    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 23:11:45.173939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.172831    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"]
Jul 07 23:11:45.174031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.173951    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.176420 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.176401    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dgnw5"]
Jul 07 23:11:45.176830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.176812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"
Jul 07 23:11:45.179634 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.179606    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.180651 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.180630    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 23:11:45.180736 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.180649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5jdmz\""
Jul 07 23:11:45.181362 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.181345    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.181632 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.179607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 23:11:45.182530 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.182510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"]
Jul 07 23:11:45.183147 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183126    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.183254 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183176    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vn985"]
Jul 07 23:11:45.183254 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183231    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"]
Jul 07 23:11:45.183377 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d8c8946bf-skgkk"]
Jul 07 23:11:45.183377 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"]
Jul 07 23:11:45.183377 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgnw5"]
Jul 07 23:11:45.183377 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-ltgrj"]
Jul 07 23:11:45.183377 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183357    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-57gv8"]
Jul 07 23:11:45.183687 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.183385    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"]
Jul 07 23:11:45.185639 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.185622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.185732 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.185715    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 23:11:45.186175 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.186156    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.187284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.186554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hhd7n\""
Jul 07 23:11:45.187284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.186841    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 23:11:45.187598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.187581    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 23:11:45.187944 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.187925    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pkjct\""
Jul 07 23:11:45.188162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.187944    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 23:11:45.191287 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.191269    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 23:11:45.221816 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwtk\" (UniqueName: \"kubernetes.io/projected/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-kube-api-access-sdwtk\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:45.221816 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.221816 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.222086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-image-registry-private-configuration\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.222086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e27321e-5392-42d1-92db-134a78bdd828-ca-trust-extracted\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.222086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-trusted-ca\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.222086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcfjn\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-kube-api-access-dcfjn\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.222086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.221963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-installation-pull-secrets\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.222086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.222019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:45.222362 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.222153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7hx\" (UniqueName: \"kubernetes.io/projected/6c034d2e-03e0-4194-af72-a546a657b0ed-kube-api-access-tz7hx\") pod \"volume-data-source-validator-5d456fdbcd-szn8n\" (UID: \"6c034d2e-03e0-4194-af72-a546a657b0ed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"
Jul 07 23:11:45.222362 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.222186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-registry-certificates\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.222362 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.222210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-bound-sa-token\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.222362 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.222236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxwxw\" (UniqueName: \"kubernetes.io/projected/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-kube-api-access-wxwxw\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.222362 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.222281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.323528 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdwtk\" (UniqueName: \"kubernetes.io/projected/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-kube-api-access-sdwtk\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:45.323528 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/901604ec-d101-44ac-a0b8-ef3230d3c972-snapshots\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.323764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.323764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-default-certificate\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.323764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.323764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e27321e-5392-42d1-92db-134a78bdd828-ca-trust-extracted\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.323764 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.323746    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901604ec-d101-44ac-a0b8-ef3230d3c972-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.323822    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls podName:f7c21abc-e29d-4ea8-a144-33e1a71ce69a nodeName:}" failed. No retries permitted until 2026-07-07 23:11:45.823800976 +0000 UTC m=+37.043785052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-69h7v" (UID: "f7c21abc-e29d-4ea8-a144-33e1a71ce69a") : secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323898    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b19a2694-8829-4e1a-b95b-d84c78c40fd4-config\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m4zc\" (UniqueName: \"kubernetes.io/projected/83929bf4-b103-4160-9b22-da08d401088c-kube-api-access-7m4zc\") pod \"network-check-source-989f8b8dc-ktpr9\" (UID: \"83929bf4-b103-4160-9b22-da08d401088c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b19a2694-8829-4e1a-b95b-d84c78c40fd4-serving-cert\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.323978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s6h6\" (UniqueName: \"kubernetes.io/projected/901604ec-d101-44ac-a0b8-ef3230d3c972-kube-api-access-2s6h6\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.324031 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ea09130-18f6-4f42-9224-35f915cd3db5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/901604ec-d101-44ac-a0b8-ef3230d3c972-serving-cert\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzqd7\" (UniqueName: \"kubernetes.io/projected/b19a2694-8829-4e1a-b95b-d84c78c40fd4-kube-api-access-kzqd7\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324084    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e27321e-5392-42d1-92db-134a78bdd828-ca-trust-extracted\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-trusted-ca\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc144964-8121-44bc-bbab-ddfa8682cbfa-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b19a2694-8829-4e1a-b95b-d84c78c40fd4-trusted-ca\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxs5d\" (UniqueName: \"kubernetes.io/projected/973dd265-f78a-47c5-a6fb-ea9ba76e8124-kube-api-access-xxs5d\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-bound-sa-token\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/973dd265-f78a-47c5-a6fb-ea9ba76e8124-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.324408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901604ec-d101-44ac-a0b8-ef3230d3c972-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-image-registry-private-configuration\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-installation-pull-secrets\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a5affdc-9b21-48a5-b731-1092e540e3f4-cert\") pod \"ingress-canary-dgnw5\" (UID: \"9a5affdc-9b21-48a5-b731-1092e540e3f4\") " pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.324474    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.324491    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687b8d59fc-d8wzr: secret "image-registry-tls" not found
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxg9w\" (UniqueName: \"kubernetes.io/projected/9a5affdc-9b21-48a5-b731-1092e540e3f4-kube-api-access-fxg9w\") pod \"ingress-canary-dgnw5\" (UID: \"9a5affdc-9b21-48a5-b731-1092e540e3f4\") " pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.324553    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls podName:4e27321e-5392-42d1-92db-134a78bdd828 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:45.824533575 +0000 UTC m=+37.044517649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls") pod "image-registry-687b8d59fc-d8wzr" (UID: "4e27321e-5392-42d1-92db-134a78bdd828") : secret "image-registry-tls" not found
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/973dd265-f78a-47c5-a6fb-ea9ba76e8124-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-stats-auth\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcfjn\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-kube-api-access-dcfjn\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:45.324969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67rxs\" (UniqueName: \"kubernetes.io/projected/dc144964-8121-44bc-bbab-ddfa8682cbfa-kube-api-access-67rxs\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj74m\" (UniqueName: \"kubernetes.io/projected/849cba2a-0dd1-4b10-b415-f3b69b206ff2-kube-api-access-fj74m\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc144964-8121-44bc-bbab-ddfa8682cbfa-config\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.324787    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7hx\" (UniqueName: \"kubernetes.io/projected/6c034d2e-03e0-4194-af72-a546a657b0ed-kube-api-access-tz7hx\") pod \"volume-data-source-validator-5d456fdbcd-szn8n\" (UID: \"6c034d2e-03e0-4194-af72-a546a657b0ed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.324844    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls podName:3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:45.824828466 +0000 UTC m=+37.044812549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nnkgb" (UID: "3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0") : secret "samples-operator-tls" not found
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/849cba2a-0dd1-4b10-b415-f3b69b206ff2-config-volume\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.324988    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-trusted-ca\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.325036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-registry-certificates\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.325054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/901604ec-d101-44ac-a0b8-ef3230d3c972-tmp\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.325088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxwxw\" (UniqueName: \"kubernetes.io/projected/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-kube-api-access-wxwxw\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.325135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849cba2a-0dd1-4b10-b415-f3b69b206ff2-tmp-dir\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.325531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.325181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsgcc\" (UniqueName: \"kubernetes.io/projected/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-kube-api-access-jsgcc\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.325940 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.325436    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-registry-certificates\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.328399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.328376    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-image-registry-private-configuration\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.328521 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.328402    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-installation-pull-secrets\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.334708 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.334652    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxwxw\" (UniqueName: \"kubernetes.io/projected/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-kube-api-access-wxwxw\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.334708 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.334664    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-bound-sa-token\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.334708 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.334690    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcfjn\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-kube-api-access-dcfjn\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.334856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.334768    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdwtk\" (UniqueName: \"kubernetes.io/projected/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-kube-api-access-sdwtk\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:45.335422 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.335406    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7hx\" (UniqueName: \"kubernetes.io/projected/6c034d2e-03e0-4194-af72-a546a657b0ed-kube-api-access-tz7hx\") pod \"volume-data-source-validator-5d456fdbcd-szn8n\" (UID: \"6c034d2e-03e0-4194-af72-a546a657b0ed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"
Jul 07 23:11:45.426278 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a5affdc-9b21-48a5-b731-1092e540e3f4-cert\") pod \"ingress-canary-dgnw5\" (UID: \"9a5affdc-9b21-48a5-b731-1092e540e3f4\") " pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.426456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxg9w\" (UniqueName: \"kubernetes.io/projected/9a5affdc-9b21-48a5-b731-1092e540e3f4-kube-api-access-fxg9w\") pod \"ingress-canary-dgnw5\" (UID: \"9a5affdc-9b21-48a5-b731-1092e540e3f4\") " pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.426456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/973dd265-f78a-47c5-a6fb-ea9ba76e8124-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.426456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-stats-auth\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.426456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:45.426456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67rxs\" (UniqueName: \"kubernetes.io/projected/dc144964-8121-44bc-bbab-ddfa8682cbfa-kube-api-access-67rxs\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.426456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj74m\" (UniqueName: \"kubernetes.io/projected/849cba2a-0dd1-4b10-b415-f3b69b206ff2-kube-api-access-fj74m\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.426456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc144964-8121-44bc-bbab-ddfa8682cbfa-config\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.426840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/849cba2a-0dd1-4b10-b415-f3b69b206ff2-config-volume\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.426840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.426840 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.426517    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 23:11:45.426840 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.426595    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert podName:5ea09130-18f6-4f42-9224-35f915cd3db5 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:45.926569228 +0000 UTC m=+37.146553301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sksvb" (UID: "5ea09130-18f6-4f42-9224-35f915cd3db5") : secret "networking-console-plugin-cert" not found
Jul 07 23:11:45.426840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/901604ec-d101-44ac-a0b8-ef3230d3c972-tmp\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.426840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849cba2a-0dd1-4b10-b415-f3b69b206ff2-tmp-dir\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.426840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsgcc\" (UniqueName: \"kubernetes.io/projected/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-kube-api-access-jsgcc\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.427304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/901604ec-d101-44ac-a0b8-ef3230d3c972-snapshots\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.427304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426900    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/901604ec-d101-44ac-a0b8-ef3230d3c972-tmp\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.427304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427215    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849cba2a-0dd1-4b10-b415-f3b69b206ff2-tmp-dir\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.427304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427284    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc144964-8121-44bc-bbab-ddfa8682cbfa-config\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.426902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-default-certificate\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901604ec-d101-44ac-a0b8-ef3230d3c972-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b19a2694-8829-4e1a-b95b-d84c78c40fd4-config\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m4zc\" (UniqueName: \"kubernetes.io/projected/83929bf4-b103-4160-9b22-da08d401088c-kube-api-access-7m4zc\") pod \"network-check-source-989f8b8dc-ktpr9\" (UID: \"83929bf4-b103-4160-9b22-da08d401088c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b19a2694-8829-4e1a-b95b-d84c78c40fd4-serving-cert\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s6h6\" (UniqueName: \"kubernetes.io/projected/901604ec-d101-44ac-a0b8-ef3230d3c972-kube-api-access-2s6h6\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.427523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427500    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/849cba2a-0dd1-4b10-b415-f3b69b206ff2-config-volume\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.427906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ea09130-18f6-4f42-9224-35f915cd3db5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:45.427906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/901604ec-d101-44ac-a0b8-ef3230d3c972-serving-cert\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.427906 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.427618    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:45.927602222 +0000 UTC m=+37.147586294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : configmap references non-existent config key: service-ca.crt
Jul 07 23:11:45.427906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzqd7\" (UniqueName: \"kubernetes.io/projected/b19a2694-8829-4e1a-b95b-d84c78c40fd4-kube-api-access-kzqd7\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.427906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427696    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/901604ec-d101-44ac-a0b8-ef3230d3c972-snapshots\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.427906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc144964-8121-44bc-bbab-ddfa8682cbfa-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.428246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b19a2694-8829-4e1a-b95b-d84c78c40fd4-trusted-ca\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.428246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.428246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.427998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxs5d\" (UniqueName: \"kubernetes.io/projected/973dd265-f78a-47c5-a6fb-ea9ba76e8124-kube-api-access-xxs5d\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.428246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.428026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/973dd265-f78a-47c5-a6fb-ea9ba76e8124-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.428246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.428084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901604ec-d101-44ac-a0b8-ef3230d3c972-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.428488 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.428289    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ea09130-18f6-4f42-9224-35f915cd3db5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:45.428875 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.428577    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901604ec-d101-44ac-a0b8-ef3230d3c972-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.428875 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.428619    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901604ec-d101-44ac-a0b8-ef3230d3c972-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.429085 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.429064    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 23:11:45.429186 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.429133    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls podName:849cba2a-0dd1-4b10-b415-f3b69b206ff2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:45.929117916 +0000 UTC m=+37.149101984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls") pod "dns-default-vn985" (UID: "849cba2a-0dd1-4b10-b415-f3b69b206ff2") : secret "dns-default-metrics-tls" not found
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.429667    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a5affdc-9b21-48a5-b731-1092e540e3f4-cert\") pod \"ingress-canary-dgnw5\" (UID: \"9a5affdc-9b21-48a5-b731-1092e540e3f4\") " pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.429761    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.429811    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:45.929796351 +0000 UTC m=+37.149780425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : secret "router-metrics-certs-default" not found
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.429822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-stats-auth\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.429888    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b19a2694-8829-4e1a-b95b-d84c78c40fd4-trusted-ca\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.430151    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/901604ec-d101-44ac-a0b8-ef3230d3c972-serving-cert\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.430420    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b19a2694-8829-4e1a-b95b-d84c78c40fd4-config\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.430460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.430435    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/973dd265-f78a-47c5-a6fb-ea9ba76e8124-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.430975 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.430954    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b19a2694-8829-4e1a-b95b-d84c78c40fd4-serving-cert\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.431223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.431204    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/973dd265-f78a-47c5-a6fb-ea9ba76e8124-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.431507 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.431480    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc144964-8121-44bc-bbab-ddfa8682cbfa-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.431891 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.431868    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-default-certificate\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.436436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.436258    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj74m\" (UniqueName: \"kubernetes.io/projected/849cba2a-0dd1-4b10-b415-f3b69b206ff2-kube-api-access-fj74m\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.436436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.436430    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxg9w\" (UniqueName: \"kubernetes.io/projected/9a5affdc-9b21-48a5-b731-1092e540e3f4-kube-api-access-fxg9w\") pod \"ingress-canary-dgnw5\" (UID: \"9a5affdc-9b21-48a5-b731-1092e540e3f4\") " pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.437049 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.437019    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsgcc\" (UniqueName: \"kubernetes.io/projected/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-kube-api-access-jsgcc\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.437288 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.437089    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67rxs\" (UniqueName: \"kubernetes.io/projected/dc144964-8121-44bc-bbab-ddfa8682cbfa-kube-api-access-67rxs\") pod \"service-ca-operator-5d46d9ffd4-zmt2j\" (UID: \"dc144964-8121-44bc-bbab-ddfa8682cbfa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.438829 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.438699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s6h6\" (UniqueName: \"kubernetes.io/projected/901604ec-d101-44ac-a0b8-ef3230d3c972-kube-api-access-2s6h6\") pod \"insights-operator-5c847dcfc4-ltgrj\" (UID: \"901604ec-d101-44ac-a0b8-ef3230d3c972\") " pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.441875 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.441827    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzqd7\" (UniqueName: \"kubernetes.io/projected/b19a2694-8829-4e1a-b95b-d84c78c40fd4-kube-api-access-kzqd7\") pod \"console-operator-68b757fb67-57gv8\" (UID: \"b19a2694-8829-4e1a-b95b-d84c78c40fd4\") " pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.442945 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.442920    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m4zc\" (UniqueName: \"kubernetes.io/projected/83929bf4-b103-4160-9b22-da08d401088c-kube-api-access-7m4zc\") pod \"network-check-source-989f8b8dc-ktpr9\" (UID: \"83929bf4-b103-4160-9b22-da08d401088c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"
Jul 07 23:11:45.443983 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.443962    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxs5d\" (UniqueName: \"kubernetes.io/projected/973dd265-f78a-47c5-a6fb-ea9ba76e8124-kube-api-access-xxs5d\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9shz\" (UID: \"973dd265-f78a-47c5-a6fb-ea9ba76e8124\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.444807 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.444778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"
Jul 07 23:11:45.470512 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.470481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"
Jul 07 23:11:45.491094 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.491058    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"
Jul 07 23:11:45.503046 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.503016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:11:45.514001 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.513960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj"
Jul 07 23:11:45.520150 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.520121    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"
Jul 07 23:11:45.524374 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.524332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgnw5"
Jul 07 23:11:45.757349 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.756955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n"]
Jul 07 23:11:45.761209 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:45.760757    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c034d2e_03e0_4194_af72_a546a657b0ed.slice/crio-fb7ecdcc5d9e152da7cb30c3af4b46a8c5fbbb13abcca05ffa21b16ac01739c3 WatchSource:0}: Error finding container fb7ecdcc5d9e152da7cb30c3af4b46a8c5fbbb13abcca05ffa21b16ac01739c3: Status 404 returned error can't find the container with id fb7ecdcc5d9e152da7cb30c3af4b46a8c5fbbb13abcca05ffa21b16ac01739c3
Jul 07 23:11:45.763258 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.763240    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-57gv8"]
Jul 07 23:11:45.767414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.767347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz"]
Jul 07 23:11:45.778398 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:45.774943    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973dd265_f78a_47c5_a6fb_ea9ba76e8124.slice/crio-7b221281603b77d15f8ef607b7ec654cf19138cf278d31d2774cb08be0ee0424 WatchSource:0}: Error finding container 7b221281603b77d15f8ef607b7ec654cf19138cf278d31d2774cb08be0ee0424: Status 404 returned error can't find the container with id 7b221281603b77d15f8ef607b7ec654cf19138cf278d31d2774cb08be0ee0424
Jul 07 23:11:45.778398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.777592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j"]
Jul 07 23:11:45.794721 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.794685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-ltgrj"]
Jul 07 23:11:45.797918 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:45.797863    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901604ec_d101_44ac_a0b8_ef3230d3c972.slice/crio-b386a13635e0485c8071fc2e8548b4cc538414cda4041085a713be01cd7d54fe WatchSource:0}: Error finding container b386a13635e0485c8071fc2e8548b4cc538414cda4041085a713be01cd7d54fe: Status 404 returned error can't find the container with id b386a13635e0485c8071fc2e8548b4cc538414cda4041085a713be01cd7d54fe
Jul 07 23:11:45.823768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.823736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgnw5"]
Jul 07 23:11:45.826889 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:45.826865    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5affdc_9b21_48a5_b731_1092e540e3f4.slice/crio-746abb5e32fe6fac6c9810c42172c01fe9cac3613fd5786661bfb9fb115a6136 WatchSource:0}: Error finding container 746abb5e32fe6fac6c9810c42172c01fe9cac3613fd5786661bfb9fb115a6136: Status 404 returned error can't find the container with id 746abb5e32fe6fac6c9810c42172c01fe9cac3613fd5786661bfb9fb115a6136
Jul 07 23:11:45.832982 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.832954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:45.833085 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.833064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:45.833165 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.833142    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:45.833216 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.833183    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 23:11:45.833216 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.833198    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687b8d59fc-d8wzr: secret "image-registry-tls" not found
Jul 07 23:11:45.833216 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.833189    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls podName:f7c21abc-e29d-4ea8-a144-33e1a71ce69a nodeName:}" failed. No retries permitted until 2026-07-07 23:11:46.833176149 +0000 UTC m=+38.053160221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-69h7v" (UID: "f7c21abc-e29d-4ea8-a144-33e1a71ce69a") : secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:45.833216 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.833214    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 23:11:45.833388 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.833248    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls podName:4e27321e-5392-42d1-92db-134a78bdd828 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:46.8332367 +0000 UTC m=+38.053220769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls") pod "image-registry-687b8d59fc-d8wzr" (UID: "4e27321e-5392-42d1-92db-134a78bdd828") : secret "image-registry-tls" not found
Jul 07 23:11:45.833388 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.833139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:45.833388 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.833262    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls podName:3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:46.833256045 +0000 UTC m=+38.053240112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nnkgb" (UID: "3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0") : secret "samples-operator-tls" not found
Jul 07 23:11:45.851895 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.851833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9"]
Jul 07 23:11:45.856648 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:11:45.856616    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83929bf4_b103_4160_9b22_da08d401088c.slice/crio-cc484e8b813e2115386d949ed5544a2cc3d93bf35461b366d40d59f46b0f9e90 WatchSource:0}: Error finding container cc484e8b813e2115386d949ed5544a2cc3d93bf35461b366d40d59f46b0f9e90: Status 404 returned error can't find the container with id cc484e8b813e2115386d949ed5544a2cc3d93bf35461b366d40d59f46b0f9e90
Jul 07 23:11:45.934160 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.934124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:45.934333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.934231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:45.934333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.934267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.934333 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.934277    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 23:11:45.934487 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.934344    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls podName:849cba2a-0dd1-4b10-b415-f3b69b206ff2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:46.934327219 +0000 UTC m=+38.154311289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls") pod "dns-default-vn985" (UID: "849cba2a-0dd1-4b10-b415-f3b69b206ff2") : secret "dns-default-metrics-tls" not found
Jul 07 23:11:45.934487 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:45.934364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:45.934487 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.934390    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 23:11:45.934487 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.934411    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:46.934394448 +0000 UTC m=+38.154378532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : configmap references non-existent config key: service-ca.crt
Jul 07 23:11:45.934487 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.934454    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert podName:5ea09130-18f6-4f42-9224-35f915cd3db5 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:46.934439024 +0000 UTC m=+38.154423094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sksvb" (UID: "5ea09130-18f6-4f42-9224-35f915cd3db5") : secret "networking-console-plugin-cert" not found
Jul 07 23:11:45.934487 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.934481    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 23:11:45.934770 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:45.934521    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:46.934508464 +0000 UTC m=+38.154492546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : secret "router-metrics-certs-default" not found
Jul 07 23:11:46.496610 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.496293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:11:46.496610 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.496311    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:11:46.496610 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.496327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:11:46.501664 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.500628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj8ww\""
Jul 07 23:11:46.501664 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.500861    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 23:11:46.501664 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.501068    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hfxvw\""
Jul 07 23:11:46.501664 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.501259    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 23:11:46.695235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.695145    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgnw5" event={"ID":"9a5affdc-9b21-48a5-b731-1092e540e3f4","Type":"ContainerStarted","Data":"746abb5e32fe6fac6c9810c42172c01fe9cac3613fd5786661bfb9fb115a6136"}
Jul 07 23:11:46.697139 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.697044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" event={"ID":"b19a2694-8829-4e1a-b95b-d84c78c40fd4","Type":"ContainerStarted","Data":"a8d67dcc0dff2e5098b764f5c1cf7268059893cf2dc3bc30f9e82b990700f26b"}
Jul 07 23:11:46.698661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.698592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz" event={"ID":"973dd265-f78a-47c5-a6fb-ea9ba76e8124","Type":"ContainerStarted","Data":"7b221281603b77d15f8ef607b7ec654cf19138cf278d31d2774cb08be0ee0424"}
Jul 07 23:11:46.710523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.710450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj" event={"ID":"901604ec-d101-44ac-a0b8-ef3230d3c972","Type":"ContainerStarted","Data":"b386a13635e0485c8071fc2e8548b4cc538414cda4041085a713be01cd7d54fe"}
Jul 07 23:11:46.713157 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.713071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j" event={"ID":"dc144964-8121-44bc-bbab-ddfa8682cbfa","Type":"ContainerStarted","Data":"0b08249927af778aba48c9fdc53d5602269cf4b8aa379d41f9492b9bee087f7f"}
Jul 07 23:11:46.717804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.717740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n" event={"ID":"6c034d2e-03e0-4194-af72-a546a657b0ed","Type":"ContainerStarted","Data":"fb7ecdcc5d9e152da7cb30c3af4b46a8c5fbbb13abcca05ffa21b16ac01739c3"}
Jul 07 23:11:46.721227 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.721090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9" event={"ID":"83929bf4-b103-4160-9b22-da08d401088c","Type":"ContainerStarted","Data":"cc484e8b813e2115386d949ed5544a2cc3d93bf35461b366d40d59f46b0f9e90"}
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.844803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.844949    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.844990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.845025    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls podName:3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:48.845003702 +0000 UTC m=+40.064987786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nnkgb" (UID: "3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0") : secret "samples-operator-tls" not found
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.845087    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.845151    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls podName:f7c21abc-e29d-4ea8-a144-33e1a71ce69a nodeName:}" failed. No retries permitted until 2026-07-07 23:11:48.845135928 +0000 UTC m=+40.065119997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-69h7v" (UID: "f7c21abc-e29d-4ea8-a144-33e1a71ce69a") : secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.845188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.845311    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.845324    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687b8d59fc-d8wzr: secret "image-registry-tls" not found
Jul 07 23:11:46.845460 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.845364    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls podName:4e27321e-5392-42d1-92db-134a78bdd828 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:48.845351186 +0000 UTC m=+40.065335256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls") pod "image-registry-687b8d59fc-d8wzr" (UID: "4e27321e-5392-42d1-92db-134a78bdd828") : secret "image-registry-tls" not found
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.946378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.946435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.946509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:46.946667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.946851    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.946913    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls podName:849cba2a-0dd1-4b10-b415-f3b69b206ff2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:48.946894598 +0000 UTC m=+40.166878687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls") pod "dns-default-vn985" (UID: "849cba2a-0dd1-4b10-b415-f3b69b206ff2") : secret "dns-default-metrics-tls" not found
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.947373    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.947428    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert podName:5ea09130-18f6-4f42-9224-35f915cd3db5 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:48.947413204 +0000 UTC m=+40.167397294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sksvb" (UID: "5ea09130-18f6-4f42-9224-35f915cd3db5") : secret "networking-console-plugin-cert" not found
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.947502    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:48.94749035 +0000 UTC m=+40.167474432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : configmap references non-existent config key: service-ca.crt
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.947559    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 23:11:46.947904 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:46.947591    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:48.947580913 +0000 UTC m=+40.167565000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : secret "router-metrics-certs-default" not found
Jul 07 23:11:48.867128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:48.866937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:48.867128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:48.867014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:48.867128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:48.867123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:48.867753 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.867275    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:48.867753 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.867340    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls podName:f7c21abc-e29d-4ea8-a144-33e1a71ce69a nodeName:}" failed. No retries permitted until 2026-07-07 23:11:52.867321044 +0000 UTC m=+44.087305116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-69h7v" (UID: "f7c21abc-e29d-4ea8-a144-33e1a71ce69a") : secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:48.867753 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.867374    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 23:11:48.867753 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.867397    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687b8d59fc-d8wzr: secret "image-registry-tls" not found
Jul 07 23:11:48.867753 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.867455    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls podName:4e27321e-5392-42d1-92db-134a78bdd828 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:52.867437726 +0000 UTC m=+44.087421794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls") pod "image-registry-687b8d59fc-d8wzr" (UID: "4e27321e-5392-42d1-92db-134a78bdd828") : secret "image-registry-tls" not found
Jul 07 23:11:48.867753 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.867519    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 23:11:48.867753 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.867553    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls podName:3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:52.867543055 +0000 UTC m=+44.087527125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nnkgb" (UID: "3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0") : secret "samples-operator-tls" not found
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:48.968456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:48.968514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:48.968580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:48.968639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.968744    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.968769    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.968772    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:52.968750094 +0000 UTC m=+44.188734162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : configmap references non-existent config key: service-ca.crt
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.968808    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert podName:5ea09130-18f6-4f42-9224-35f915cd3db5 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:52.968791231 +0000 UTC m=+44.188775319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sksvb" (UID: "5ea09130-18f6-4f42-9224-35f915cd3db5") : secret "networking-console-plugin-cert" not found
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.968828    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls podName:849cba2a-0dd1-4b10-b415-f3b69b206ff2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:52.968818262 +0000 UTC m=+44.188802341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls") pod "dns-default-vn985" (UID: "849cba2a-0dd1-4b10-b415-f3b69b206ff2") : secret "dns-default-metrics-tls" not found
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.968833    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 23:11:48.968899 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:48.968868    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:11:52.968855377 +0000 UTC m=+44.188839462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : secret "router-metrics-certs-default" not found
Jul 07 23:11:52.904384 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:52.904348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:52.904522    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:52.904526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:52.904591    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:52.904613    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls podName:f7c21abc-e29d-4ea8-a144-33e1a71ce69a nodeName:}" failed. No retries permitted until 2026-07-07 23:12:00.904590668 +0000 UTC m=+52.124574741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-69h7v" (UID: "f7c21abc-e29d-4ea8-a144-33e1a71ce69a") : secret "cluster-monitoring-operator-tls" not found
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:52.904613    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687b8d59fc-d8wzr: secret "image-registry-tls" not found
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:52.904678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:52.904694    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls podName:4e27321e-5392-42d1-92db-134a78bdd828 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:00.904681754 +0000 UTC m=+52.124665821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls") pod "image-registry-687b8d59fc-d8wzr" (UID: "4e27321e-5392-42d1-92db-134a78bdd828") : secret "image-registry-tls" not found
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:52.904742    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 23:11:52.904813 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:52.904781    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls podName:3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:00.904769318 +0000 UTC m=+52.124753390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nnkgb" (UID: "3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0") : secret "samples-operator-tls" not found
Jul 07 23:11:53.005740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:53.005705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:53.005908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:53.005779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:11:53.005908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:53.005859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:11:53.005908 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:53.005860    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 23:11:53.006042 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:53.005931    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:12:01.005915394 +0000 UTC m=+52.225899464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : secret "router-metrics-certs-default" not found
Jul 07 23:11:53.006042 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:53.005941    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 23:11:53.006042 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:53.006002    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls podName:849cba2a-0dd1-4b10-b415-f3b69b206ff2 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:01.005983896 +0000 UTC m=+52.225967972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls") pod "dns-default-vn985" (UID: "849cba2a-0dd1-4b10-b415-f3b69b206ff2") : secret "dns-default-metrics-tls" not found
Jul 07 23:11:53.006042 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:53.006009    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 23:11:53.006259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:53.006050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:11:53.006259 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:53.006061    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert podName:5ea09130-18f6-4f42-9224-35f915cd3db5 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:01.006047907 +0000 UTC m=+52.226031979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sksvb" (UID: "5ea09130-18f6-4f42-9224-35f915cd3db5") : secret "networking-console-plugin-cert" not found
Jul 07 23:11:53.006259 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:53.006148    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:12:01.006136616 +0000 UTC m=+52.226120703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : configmap references non-existent config key: service-ca.crt
Jul 07 23:11:56.754359 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.754325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgnw5" event={"ID":"9a5affdc-9b21-48a5-b731-1092e540e3f4","Type":"ContainerStarted","Data":"6983703bf8cf704afe1b993f73428c4cc990f906042f01b0f83172b2451d28fd"}
Jul 07 23:11:56.756137 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.756114    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/0.log"
Jul 07 23:11:56.756264 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.756155    2581 generic.go:356] "Generic (PLEG): container finished" podID="b19a2694-8829-4e1a-b95b-d84c78c40fd4" containerID="5afbfa470c7ec6f03cdb9c47053c4a619861167d1eb6aa5d04f18721a22daa9f" exitCode=255
Jul 07 23:11:56.756264 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.756228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" event={"ID":"b19a2694-8829-4e1a-b95b-d84c78c40fd4","Type":"ContainerDied","Data":"5afbfa470c7ec6f03cdb9c47053c4a619861167d1eb6aa5d04f18721a22daa9f"}
Jul 07 23:11:56.756432 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.756416    2581 scope.go:117] "RemoveContainer" containerID="5afbfa470c7ec6f03cdb9c47053c4a619861167d1eb6aa5d04f18721a22daa9f"
Jul 07 23:11:56.757712 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.757687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz" event={"ID":"973dd265-f78a-47c5-a6fb-ea9ba76e8124","Type":"ContainerStarted","Data":"76e2feb48353c27346e1799b5e92e6aa920566627450757a7e5577b776c940ce"}
Jul 07 23:11:56.763566 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.763540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj" event={"ID":"901604ec-d101-44ac-a0b8-ef3230d3c972","Type":"ContainerStarted","Data":"6c024d12321d7dec587397c1b41b7cf81d3cbc95e59fdd2853ce3070b2da3529"}
Jul 07 23:11:56.767092 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.767066    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd5bf802-afe5-4a9e-88ac-764613fdd218" containerID="806ee4566761a744fafbea6a3b612f4a8006924a342822c90482322cd54bc777" exitCode=0
Jul 07 23:11:56.767191 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.767170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerDied","Data":"806ee4566761a744fafbea6a3b612f4a8006924a342822c90482322cd54bc777"}
Jul 07 23:11:56.769248 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.769226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j" event={"ID":"dc144964-8121-44bc-bbab-ddfa8682cbfa","Type":"ContainerStarted","Data":"3021334e1a5ffd9b7620af8068951380c0b03909c4e94b8a1e1a94ba597b6ebf"}
Jul 07 23:11:56.772194 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.771998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dgnw5" podStartSLOduration=1.8491562030000002 podStartE2EDuration="11.771982355s" totalImagesPullingTime="9.922826152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:56.770801503 +0000 UTC m=+47.990785595" watchObservedRunningTime="2026-07-07 23:11:56.771982355 +0000 UTC m=+47.991966424"
Jul 07 23:11:56.775909 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.775834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n" event={"ID":"6c034d2e-03e0-4194-af72-a546a657b0ed","Type":"ContainerStarted","Data":"4f4203cc4f601dfb36720660443f70f445c6f56b51575bb73f236741c33b470e"}
Jul 07 23:11:56.778240 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.778219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9" event={"ID":"83929bf4-b103-4160-9b22-da08d401088c","Type":"ContainerStarted","Data":"bb123f5b35feda8ca3920d755ac7028199e7e24241ff86dda86a045980caa979"}
Jul 07 23:11:56.808327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.808282    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j" podStartSLOduration=14.840577938 podStartE2EDuration="24.808264658s" totalImagesPullingTime="9.96768672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:56.807711321 +0000 UTC m=+48.027695411" watchObservedRunningTime="2026-07-07 23:11:56.808264658 +0000 UTC m=+48.028248748"
Jul 07 23:11:56.871939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.870895    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj" podStartSLOduration=14.921379215 podStartE2EDuration="24.870875471s" totalImagesPullingTime="9.949496256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:56.849712203 +0000 UTC m=+48.069696293" watchObservedRunningTime="2026-07-07 23:11:56.870875471 +0000 UTC m=+48.090859562"
Jul 07 23:11:56.893695 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.893263    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz" podStartSLOduration=14.924897005 podStartE2EDuration="24.893243475s" totalImagesPullingTime="9.96834647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:56.871802218 +0000 UTC m=+48.091786308" watchObservedRunningTime="2026-07-07 23:11:56.893243475 +0000 UTC m=+48.113227569"
Jul 07 23:11:56.893695 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.893411    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktpr9" podStartSLOduration=14.989505781 podStartE2EDuration="24.893405047s" totalImagesPullingTime="9.903899266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:56.891966033 +0000 UTC m=+48.111950122" watchObservedRunningTime="2026-07-07 23:11:56.893405047 +0000 UTC m=+48.113389140"
Jul 07 23:11:56.908917 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:56.907066    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-szn8n" podStartSLOduration=15.034604903 podStartE2EDuration="24.907048563s" totalImagesPullingTime="9.87244366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:56.906320599 +0000 UTC m=+48.126304689" watchObservedRunningTime="2026-07-07 23:11:56.907048563 +0000 UTC m=+48.127032657"
Jul 07 23:11:57.251023 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.250988    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jl6ms"]
Jul 07 23:11:57.266465 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.266426    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jl6ms"]
Jul 07 23:11:57.266768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.266751    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.269543 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.269518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvbwm\""
Jul 07 23:11:57.269857 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.269837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 23:11:57.270500 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.270046    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 23:11:57.344990 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.344965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04bad7be-83bb-4424-a30f-49d8f99e1110-crio-socket\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.345136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.345017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.345136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.345112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04bad7be-83bb-4424-a30f-49d8f99e1110-data-volume\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.345253 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.345234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.345312 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.345294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdlfh\" (UniqueName: \"kubernetes.io/projected/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-api-access-xdlfh\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.446567 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.446531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.446757 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.446585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdlfh\" (UniqueName: \"kubernetes.io/projected/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-api-access-xdlfh\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.446757 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.446668    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 23:11:57.446757 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.446740    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:57.94671913 +0000 UTC m=+49.166703209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : configmap "kube-rbac-proxy" not found
Jul 07 23:11:57.446942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.446815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04bad7be-83bb-4424-a30f-49d8f99e1110-crio-socket\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.446942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.446888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.446942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.446934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04bad7be-83bb-4424-a30f-49d8f99e1110-data-volume\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.447093 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.447005    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04bad7be-83bb-4424-a30f-49d8f99e1110-crio-socket\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.447093 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.447014    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 23:11:57.447093 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.447095    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:57.947077016 +0000 UTC m=+49.167061087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : secret "insights-runtime-extractor-tls" not found
Jul 07 23:11:57.447284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.447257    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04bad7be-83bb-4424-a30f-49d8f99e1110-data-volume\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.456558 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.456528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdlfh\" (UniqueName: \"kubernetes.io/projected/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-api-access-xdlfh\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.783623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.783555    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:11:57.783983 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.783955    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/0.log"
Jul 07 23:11:57.784040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.783985    2581 generic.go:356] "Generic (PLEG): container finished" podID="b19a2694-8829-4e1a-b95b-d84c78c40fd4" containerID="2c459f49457cc2ee87b1e2e1383af03655d7328e5563d6d22e38a0ffaa7e0d71" exitCode=255
Jul 07 23:11:57.784040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.784018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" event={"ID":"b19a2694-8829-4e1a-b95b-d84c78c40fd4","Type":"ContainerDied","Data":"2c459f49457cc2ee87b1e2e1383af03655d7328e5563d6d22e38a0ffaa7e0d71"}
Jul 07 23:11:57.784160 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.784119    2581 scope.go:117] "RemoveContainer" containerID="5afbfa470c7ec6f03cdb9c47053c4a619861167d1eb6aa5d04f18721a22daa9f"
Jul 07 23:11:57.784325 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.784309    2581 scope.go:117] "RemoveContainer" containerID="2c459f49457cc2ee87b1e2e1383af03655d7328e5563d6d22e38a0ffaa7e0d71"
Jul 07 23:11:57.784480 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.784464    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-57gv8_openshift-console-operator(b19a2694-8829-4e1a-b95b-d84c78c40fd4)\"" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" podUID="b19a2694-8829-4e1a-b95b-d84c78c40fd4"
Jul 07 23:11:57.787597 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.787571    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd5bf802-afe5-4a9e-88ac-764613fdd218" containerID="bf0d11857e868321bf27772b4831b200045f220ae16356793abb26b3681139b0" exitCode=0
Jul 07 23:11:57.787705 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.787678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerDied","Data":"bf0d11857e868321bf27772b4831b200045f220ae16356793abb26b3681139b0"}
Jul 07 23:11:57.953177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.953150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.953278 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:57.953243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:57.953323 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.953299    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 23:11:57.953369 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.953359    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:58.953342093 +0000 UTC m=+50.173326183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : secret "insights-runtime-extractor-tls" not found
Jul 07 23:11:57.953369 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.953357    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 23:11:57.953462 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:57.953390    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:58.953384096 +0000 UTC m=+50.173368163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : configmap "kube-rbac-proxy" not found
Jul 07 23:11:58.797206 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:58.797176    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:11:58.797624 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:58.797530    2581 scope.go:117] "RemoveContainer" containerID="2c459f49457cc2ee87b1e2e1383af03655d7328e5563d6d22e38a0ffaa7e0d71"
Jul 07 23:11:58.797725 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:58.797704    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-57gv8_openshift-console-operator(b19a2694-8829-4e1a-b95b-d84c78c40fd4)\"" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" podUID="b19a2694-8829-4e1a-b95b-d84c78c40fd4"
Jul 07 23:11:58.800687 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:58.800666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjztw" event={"ID":"bd5bf802-afe5-4a9e-88ac-764613fdd218","Type":"ContainerStarted","Data":"6065e53b9668df5172c8f8162362aab62c3291cd5b1e0aba3bb9d1b68cdb99bc"}
Jul 07 23:11:58.837913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:58.837816    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bjztw" podStartSLOduration=9.1693319 podStartE2EDuration="48.83779998s" totalImagesPullingTime="39.66846808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:58.837051209 +0000 UTC m=+50.057035298" watchObservedRunningTime="2026-07-07 23:11:58.83779998 +0000 UTC m=+50.057784069"
Jul 07 23:11:58.963926 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:58.963889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:58.964116 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:58.964017    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 23:11:58.964116 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:58.964074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:11:58.964196 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:58.964132    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:00.964114898 +0000 UTC m=+52.184098965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : configmap "kube-rbac-proxy" not found
Jul 07 23:11:58.964240 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:58.964199    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 23:11:58.964273 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:11:58.964263    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:00.964249828 +0000 UTC m=+52.184233898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : secret "insights-runtime-extractor-tls" not found
Jul 07 23:11:59.451791 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:11:59.451761    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7j978_0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac/dns-node-resolver/0.log"
Jul 07 23:12:00.253002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:00.252971    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gpv7s_5cd5bfae-3ca7-42df-8dcf-0c8a409818ed/node-ca/0.log"
Jul 07 23:12:00.980421 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:00.980387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:12:00.980604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:00.980441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:12:00.980604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:00.980515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:12:00.980604 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980548    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 23:12:00.980604 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980603    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls podName:3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:16.980588423 +0000 UTC m=+68.200572493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nnkgb" (UID: "3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0") : secret "samples-operator-tls" not found
Jul 07 23:12:00.980738 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980615    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 23:12:00.980738 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:00.980635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:12:00.980738 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980682    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:04.980669208 +0000 UTC m=+56.200653280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : secret "insights-runtime-extractor-tls" not found
Jul 07 23:12:00.980738 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980684    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 23:12:00.980738 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980731    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls podName:f7c21abc-e29d-4ea8-a144-33e1a71ce69a nodeName:}" failed. No retries permitted until 2026-07-07 23:12:16.980719139 +0000 UTC m=+68.200703218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-69h7v" (UID: "f7c21abc-e29d-4ea8-a144-33e1a71ce69a") : secret "cluster-monitoring-operator-tls" not found
Jul 07 23:12:00.980906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:00.980776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:12:00.980906 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980837    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 23:12:00.980906 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980847    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687b8d59fc-d8wzr: secret "image-registry-tls" not found
Jul 07 23:12:00.980906 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:00.980875    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls podName:4e27321e-5392-42d1-92db-134a78bdd828 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:16.980867111 +0000 UTC m=+68.200851178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls") pod "image-registry-687b8d59fc-d8wzr" (UID: "4e27321e-5392-42d1-92db-134a78bdd828") : secret "image-registry-tls" not found
Jul 07 23:12:00.981213 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:00.981195    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04bad7be-83bb-4424-a30f-49d8f99e1110-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:12:01.081247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:01.081214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:01.081402 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:01.081270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:12:01.081402 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:01.081328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:12:01.081402 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:01.081363    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 23:12:01.081502 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:01.081423    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:12:17.081408272 +0000 UTC m=+68.301392342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : secret "router-metrics-certs-default" not found
Jul 07 23:12:01.081502 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:01.081428    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 23:12:01.081502 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:01.081366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:01.081502 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:01.081445    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle podName:7fe35cca-ab40-4105-ad17-eff2a9ecef1c nodeName:}" failed. No retries permitted until 2026-07-07 23:12:17.0814293 +0000 UTC m=+68.301413372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle") pod "router-default-5d8c8946bf-skgkk" (UID: "7fe35cca-ab40-4105-ad17-eff2a9ecef1c") : configmap references non-existent config key: service-ca.crt
Jul 07 23:12:01.081502 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:01.081494    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls podName:849cba2a-0dd1-4b10-b415-f3b69b206ff2 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:17.081483062 +0000 UTC m=+68.301467129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls") pod "dns-default-vn985" (UID: "849cba2a-0dd1-4b10-b415-f3b69b206ff2") : secret "dns-default-metrics-tls" not found
Jul 07 23:12:01.081502 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:01.081432    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 23:12:01.081689 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:01.081541    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert podName:5ea09130-18f6-4f42-9224-35f915cd3db5 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:17.081534423 +0000 UTC m=+68.301518490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sksvb" (UID: "5ea09130-18f6-4f42-9224-35f915cd3db5") : secret "networking-console-plugin-cert" not found
Jul 07 23:12:01.253033 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:01.252965    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgnw5_9a5affdc-9b21-48a5-b731-1092e540e3f4/serve-healthcheck-canary/0.log"
Jul 07 23:12:05.015754 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:05.015708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:12:05.016203 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:05.015857    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 23:12:05.016203 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:05.015921    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls podName:04bad7be-83bb-4424-a30f-49d8f99e1110 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:13.015906582 +0000 UTC m=+64.235890652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jl6ms" (UID: "04bad7be-83bb-4424-a30f-49d8f99e1110") : secret "insights-runtime-extractor-tls" not found
Jul 07 23:12:05.504024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:05.503996    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:12:05.504202 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:05.504039    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:12:05.504392 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:05.504379    2581 scope.go:117] "RemoveContainer" containerID="2c459f49457cc2ee87b1e2e1383af03655d7328e5563d6d22e38a0ffaa7e0d71"
Jul 07 23:12:05.504569 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:12:05.504552    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-57gv8_openshift-console-operator(b19a2694-8829-4e1a-b95b-d84c78c40fd4)\"" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" podUID="b19a2694-8829-4e1a-b95b-d84c78c40fd4"
Jul 07 23:12:09.648811 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:09.648783    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxh4z"
Jul 07 23:12:13.085137 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:13.085082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:12:13.087398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:13.087369    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04bad7be-83bb-4424-a30f-49d8f99e1110-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jl6ms\" (UID: \"04bad7be-83bb-4424-a30f-49d8f99e1110\") " pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:12:13.182798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:13.182768    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvbwm\""
Jul 07 23:12:13.191089 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:13.191069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jl6ms"
Jul 07 23:12:13.311455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:13.311426    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jl6ms"]
Jul 07 23:12:13.314153 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:13.314130    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04bad7be_83bb_4424_a30f_49d8f99e1110.slice/crio-4c8aeefc9de774c28f916b590d3350694795758a5c7cdb274ebb812dccc284c7 WatchSource:0}: Error finding container 4c8aeefc9de774c28f916b590d3350694795758a5c7cdb274ebb812dccc284c7: Status 404 returned error can't find the container with id 4c8aeefc9de774c28f916b590d3350694795758a5c7cdb274ebb812dccc284c7
Jul 07 23:12:13.853160 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:13.853115    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl6ms" event={"ID":"04bad7be-83bb-4424-a30f-49d8f99e1110","Type":"ContainerStarted","Data":"4c8aeefc9de774c28f916b590d3350694795758a5c7cdb274ebb812dccc284c7"}
Jul 07 23:12:15.107607 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.107568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:12:15.108056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.107712    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:12:15.110240 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.110220    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 23:12:15.111207 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.111188    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 23:12:15.120437 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.120416    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd7ffe5a-2577-4511-99d8-79de623c8a52-original-pull-secret\") pod \"global-pull-secret-syncer-frvk2\" (UID: \"dd7ffe5a-2577-4511-99d8-79de623c8a52\") " pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:12:15.120437 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.120428    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daf750d5-c5fc-4b4d-a9b9-8933bbdf9008-metrics-certs\") pod \"network-metrics-daemon-mlfz4\" (UID: \"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008\") " pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:12:15.208284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.208247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:12:15.211001 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.210972    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck9zl\" (UniqueName: \"kubernetes.io/projected/9b541648-d620-47c0-bd51-1e7d61c20366-kube-api-access-ck9zl\") pod \"network-check-target-pbj79\" (UID: \"9b541648-d620-47c0-bd51-1e7d61c20366\") " pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:12:15.315223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.315191    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hfxvw\""
Jul 07 23:12:15.322388 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.322364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frvk2"
Jul 07 23:12:15.323393 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.323370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlfz4"
Jul 07 23:12:15.331043 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.331023    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj8ww\""
Jul 07 23:12:15.339239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:15.339215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:12:16.497402 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:16.497366    2581 scope.go:117] "RemoveContainer" containerID="2c459f49457cc2ee87b1e2e1383af03655d7328e5563d6d22e38a0ffaa7e0d71"
Jul 07 23:12:17.026069 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.025475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:12:17.026069 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.025583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:12:17.026069 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.025665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:12:17.030303 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.030237    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nnkgb\" (UID: \"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:12:17.031056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.031009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7c21abc-e29d-4ea8-a144-33e1a71ce69a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-69h7v\" (UID: \"f7c21abc-e29d-4ea8-a144-33e1a71ce69a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:12:17.032296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.032251    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"image-registry-687b8d59fc-d8wzr\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") " pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:12:17.043891 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.043807    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pbj79"]
Jul 07 23:12:17.048545 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:17.048465    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b541648_d620_47c0_bd51_1e7d61c20366.slice/crio-0ce5868a9ff86701c933c37b8b1339b93569d99552cc086384d318ff4db38474 WatchSource:0}: Error finding container 0ce5868a9ff86701c933c37b8b1339b93569d99552cc086384d318ff4db38474: Status 404 returned error can't find the container with id 0ce5868a9ff86701c933c37b8b1339b93569d99552cc086384d318ff4db38474
Jul 07 23:12:17.069368 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.065623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mlfz4"]
Jul 07 23:12:17.089088 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.089066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-frvk2"]
Jul 07 23:12:17.099135 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:17.099068    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7ffe5a_2577_4511_99d8_79de623c8a52.slice/crio-7ad0ae31785878d4298416a6079f8467bfb68041fe6028f7b8d07544ab000aab WatchSource:0}: Error finding container 7ad0ae31785878d4298416a6079f8467bfb68041fe6028f7b8d07544ab000aab: Status 404 returned error can't find the container with id 7ad0ae31785878d4298416a6079f8467bfb68041fe6028f7b8d07544ab000aab
Jul 07 23:12:17.126270 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.126248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:12:17.126395 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.126301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:12:17.126395 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.126367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:17.126474 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.126421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:17.127076 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.127044    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-service-ca-bundle\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:17.128462 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.128440    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ea09130-18f6-4f42-9224-35f915cd3db5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sksvb\" (UID: \"5ea09130-18f6-4f42-9224-35f915cd3db5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:12:17.128556 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.128471    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/849cba2a-0dd1-4b10-b415-f3b69b206ff2-metrics-tls\") pod \"dns-default-vn985\" (UID: \"849cba2a-0dd1-4b10-b415-f3b69b206ff2\") " pod="openshift-dns/dns-default-vn985"
Jul 07 23:12:17.128608 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.128559    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe35cca-ab40-4105-ad17-eff2a9ecef1c-metrics-certs\") pod \"router-default-5d8c8946bf-skgkk\" (UID: \"7fe35cca-ab40-4105-ad17-eff2a9ecef1c\") " pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:17.235119 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.235024    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nvxgx\""
Jul 07 23:12:17.243199 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.243178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"
Jul 07 23:12:17.254758 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.254736    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8m9kl\""
Jul 07 23:12:17.263015 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.262991    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"
Jul 07 23:12:17.263399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.263380    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-76ckg\""
Jul 07 23:12:17.271629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.271609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:12:17.282746 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.282416    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-78s5w\""
Jul 07 23:12:17.289783 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.289743    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vn985"
Jul 07 23:12:17.299585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.299557    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-22dhs\""
Jul 07 23:12:17.312571 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.308795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"
Jul 07 23:12:17.312571 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.312128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lvl65\""
Jul 07 23:12:17.320912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.320592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:17.431535 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.428691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb"]
Jul 07 23:12:17.455457 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.455159    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v"]
Jul 07 23:12:17.520182 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.520150    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687b8d59fc-d8wzr"]
Jul 07 23:12:17.527871 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:17.527827    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e27321e_5392_42d1_92db_134a78bdd828.slice/crio-9e382514acad13a4641a271656992bb212b776037177080a8d3330133362e470 WatchSource:0}: Error finding container 9e382514acad13a4641a271656992bb212b776037177080a8d3330133362e470: Status 404 returned error can't find the container with id 9e382514acad13a4641a271656992bb212b776037177080a8d3330133362e470
Jul 07 23:12:17.545039 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.544915    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vn985"]
Jul 07 23:12:17.545681 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:17.545581    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849cba2a_0dd1_4b10_b415_f3b69b206ff2.slice/crio-5225c933984f775505749945165c5164e53e61eada957f156b303a3e962f481c WatchSource:0}: Error finding container 5225c933984f775505749945165c5164e53e61eada957f156b303a3e962f481c: Status 404 returned error can't find the container with id 5225c933984f775505749945165c5164e53e61eada957f156b303a3e962f481c
Jul 07 23:12:17.564550 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.564177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-sksvb"]
Jul 07 23:12:17.568462 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:17.568413    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea09130_18f6_4f42_9224_35f915cd3db5.slice/crio-668ea00f417dce9c07bbc59cc656ec1b4ff882db64e0e3b771c3d85f8531331a WatchSource:0}: Error finding container 668ea00f417dce9c07bbc59cc656ec1b4ff882db64e0e3b771c3d85f8531331a: Status 404 returned error can't find the container with id 668ea00f417dce9c07bbc59cc656ec1b4ff882db64e0e3b771c3d85f8531331a
Jul 07 23:12:17.603472 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.603445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d8c8946bf-skgkk"]
Jul 07 23:12:17.662291 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:17.662261    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe35cca_ab40_4105_ad17_eff2a9ecef1c.slice/crio-10db8b1af7bde25fee1278b93a0e836a070e94cb715ccfc8f835e18638b22397 WatchSource:0}: Error finding container 10db8b1af7bde25fee1278b93a0e836a070e94cb715ccfc8f835e18638b22397: Status 404 returned error can't find the container with id 10db8b1af7bde25fee1278b93a0e836a070e94cb715ccfc8f835e18638b22397
Jul 07 23:12:17.871751 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.870979    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:12:17.871751 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.871084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" event={"ID":"b19a2694-8829-4e1a-b95b-d84c78c40fd4","Type":"ContainerStarted","Data":"7edcdfafa2ebfe6f0f901597395c172e3fbc6a2f34aecea455e9f12814bcebe5"}
Jul 07 23:12:17.871751 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.871607    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:12:17.873756 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.873708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d8c8946bf-skgkk" event={"ID":"7fe35cca-ab40-4105-ad17-eff2a9ecef1c","Type":"ContainerStarted","Data":"a41917af67678ca6d75684434e5a7d35aae9b3680cf92125e4daed31ad0af398"}
Jul 07 23:12:17.873756 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.873751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d8c8946bf-skgkk" event={"ID":"7fe35cca-ab40-4105-ad17-eff2a9ecef1c","Type":"ContainerStarted","Data":"10db8b1af7bde25fee1278b93a0e836a070e94cb715ccfc8f835e18638b22397"}
Jul 07 23:12:17.877242 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.877214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pbj79" event={"ID":"9b541648-d620-47c0-bd51-1e7d61c20366","Type":"ContainerStarted","Data":"8f15eaa2f48b64c4de2e28a146b590fef93eb42aff00fedad4d5f38694e3e606"}
Jul 07 23:12:17.877359 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.877259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pbj79" event={"ID":"9b541648-d620-47c0-bd51-1e7d61c20366","Type":"ContainerStarted","Data":"0ce5868a9ff86701c933c37b8b1339b93569d99552cc086384d318ff4db38474"}
Jul 07 23:12:17.878290 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.877681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:12:17.881528 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.879830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-57gv8"
Jul 07 23:12:17.881794 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.881771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl6ms" event={"ID":"04bad7be-83bb-4424-a30f-49d8f99e1110","Type":"ContainerStarted","Data":"6f1d9501b6e8b2d728b02d1035fadeeb0c5d5aac6591f3c08e061e5386beeee7"}
Jul 07 23:12:17.881892 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.881828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl6ms" event={"ID":"04bad7be-83bb-4424-a30f-49d8f99e1110","Type":"ContainerStarted","Data":"7b274ea55e13ebe92a66ce624251d412257c8b6b542452fac960717f46624ed9"}
Jul 07 23:12:17.883532 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.883495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vn985" event={"ID":"849cba2a-0dd1-4b10-b415-f3b69b206ff2","Type":"ContainerStarted","Data":"5225c933984f775505749945165c5164e53e61eada957f156b303a3e962f481c"}
Jul 07 23:12:17.885401 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.885296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr" event={"ID":"4e27321e-5392-42d1-92db-134a78bdd828","Type":"ContainerStarted","Data":"c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db"}
Jul 07 23:12:17.885401 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.885337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr" event={"ID":"4e27321e-5392-42d1-92db-134a78bdd828","Type":"ContainerStarted","Data":"9e382514acad13a4641a271656992bb212b776037177080a8d3330133362e470"}
Jul 07 23:12:17.885401 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.885381    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:12:17.886816 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.886765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v" event={"ID":"f7c21abc-e29d-4ea8-a144-33e1a71ce69a","Type":"ContainerStarted","Data":"8d5bc42a422392a63997a15b6d0cc3ffdea78073bdaf1b741b8e252b776672f4"}
Jul 07 23:12:17.888236 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.888162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb" event={"ID":"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0","Type":"ContainerStarted","Data":"e3c775fddecf257b2c9b4907e0b8df4987b3f52bb2a667ea61e729a78bd5e008"}
Jul 07 23:12:17.889572 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.889552    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-frvk2" event={"ID":"dd7ffe5a-2577-4511-99d8-79de623c8a52","Type":"ContainerStarted","Data":"7ad0ae31785878d4298416a6079f8467bfb68041fe6028f7b8d07544ab000aab"}
Jul 07 23:12:17.891268 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.890724    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-57gv8" podStartSLOduration=35.918804508 podStartE2EDuration="45.890707713s" totalImagesPullingTime="9.971903205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:17.89001666 +0000 UTC m=+69.110000750" watchObservedRunningTime="2026-07-07 23:12:17.890707713 +0000 UTC m=+69.110691783"
Jul 07 23:12:17.891523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.891499    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb" event={"ID":"5ea09130-18f6-4f42-9224-35f915cd3db5","Type":"ContainerStarted","Data":"668ea00f417dce9c07bbc59cc656ec1b4ff882db64e0e3b771c3d85f8531331a"}
Jul 07 23:12:17.893065 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.893042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlfz4" event={"ID":"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008","Type":"ContainerStarted","Data":"f6eef019ea79c845f0762b323ebf2cc7c2a754b066b1cd19760280a949da8d28"}
Jul 07 23:12:17.926826 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.926187    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr" podStartSLOduration=67.926166662 podStartE2EDuration="1m7.926166662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:17.925369033 +0000 UTC m=+69.145353147" watchObservedRunningTime="2026-07-07 23:12:17.926166662 +0000 UTC m=+69.146150752"
Jul 07 23:12:17.962234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.960804    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d8c8946bf-skgkk" podStartSLOduration=45.960784258 podStartE2EDuration="45.960784258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:17.944441141 +0000 UTC m=+69.164425231" watchObservedRunningTime="2026-07-07 23:12:17.960784258 +0000 UTC m=+69.180768348"
Jul 07 23:12:17.962234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:17.961683    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pbj79" podStartSLOduration=67.961672116 podStartE2EDuration="1m7.961672116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:17.960410602 +0000 UTC m=+69.180394692" watchObservedRunningTime="2026-07-07 23:12:17.961672116 +0000 UTC m=+69.181656206"
Jul 07 23:12:18.321653 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:18.321563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:18.324592 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:18.324565    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:18.918970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:18.916850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlfz4" event={"ID":"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008","Type":"ContainerStarted","Data":"58a30d8c97aa770d557fe51d846b967b6e85d6895e409858c135da25ed3789ad"}
Jul 07 23:12:18.918970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:18.918708    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:18.918970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:18.918763    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d8c8946bf-skgkk"
Jul 07 23:12:19.924126 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:19.924023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlfz4" event={"ID":"daf750d5-c5fc-4b4d-a9b9-8933bbdf9008","Type":"ContainerStarted","Data":"83b8f6fe88fea390584e070a4b7a81e07c8f29408fa00161a11b3845aa07d872"}
Jul 07 23:12:19.941550 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:19.941492    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mlfz4" podStartSLOduration=68.394944923 podStartE2EDuration="1m9.941470175s" totalImagesPullingTime="1.546525252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:19.939645013 +0000 UTC m=+71.159629104" watchObservedRunningTime="2026-07-07 23:12:19.941470175 +0000 UTC m=+71.161454268"
Jul 07 23:12:23.649613 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.649580    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66df6fd7f4-7zjsn"]
Jul 07 23:12:23.683198 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.683169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.687505 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.687478    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 23:12:23.687642 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.687583    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 23:12:23.687713 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.687484    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 23:12:23.687873 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.687855    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 23:12:23.688891 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.688838    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2dr4g\""
Jul 07 23:12:23.689117 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.688949    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 23:12:23.689242 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.689163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 23:12:23.689242 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.689236    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 23:12:23.698156 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.698132    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66df6fd7f4-7zjsn"]
Jul 07 23:12:23.789744 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.789664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rs8f\" (UniqueName: \"kubernetes.io/projected/e59c045d-40d0-423f-90e9-459b0c2ea094-kube-api-access-4rs8f\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.789925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.789756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-serving-cert\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.789925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.789795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-console-config\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.789925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.789814    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-service-ca\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.789925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.789840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-oauth-config\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.789925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.789865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-oauth-serving-cert\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.891159 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.891117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rs8f\" (UniqueName: \"kubernetes.io/projected/e59c045d-40d0-423f-90e9-459b0c2ea094-kube-api-access-4rs8f\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.891341 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.891213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-serving-cert\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.891341 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.891240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-console-config\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.891341 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.891261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-service-ca\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.891341 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.891297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-oauth-config\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.891341 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.891328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-oauth-serving-cert\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.892126 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.892052    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-service-ca\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.892126 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.892091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-oauth-serving-cert\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.892126 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.892123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-console-config\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.894041 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.894015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-oauth-config\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.894171 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.894021    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-serving-cert\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.906079 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.906054    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rs8f\" (UniqueName: \"kubernetes.io/projected/e59c045d-40d0-423f-90e9-459b0c2ea094-kube-api-access-4rs8f\") pod \"console-66df6fd7f4-7zjsn\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") " pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:23.994951 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:23.994907    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:24.699998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:24.699868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66df6fd7f4-7zjsn"]
Jul 07 23:12:24.842076 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:24.842049    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59c045d_40d0_423f_90e9_459b0c2ea094.slice/crio-6d25f15882d9830d0d79dd4d1e644a30c6513f26f11abcf818ff93652524c08d WatchSource:0}: Error finding container 6d25f15882d9830d0d79dd4d1e644a30c6513f26f11abcf818ff93652524c08d: Status 404 returned error can't find the container with id 6d25f15882d9830d0d79dd4d1e644a30c6513f26f11abcf818ff93652524c08d
Jul 07 23:12:24.947364 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:24.947334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vn985" event={"ID":"849cba2a-0dd1-4b10-b415-f3b69b206ff2","Type":"ContainerStarted","Data":"9d62b169fb9e9c5cbcdc646ecefc1b74d078ee54db18be0336dee0408b8bcf1d"}
Jul 07 23:12:24.948718 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:24.948689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66df6fd7f4-7zjsn" event={"ID":"e59c045d-40d0-423f-90e9-459b0c2ea094","Type":"ContainerStarted","Data":"6d25f15882d9830d0d79dd4d1e644a30c6513f26f11abcf818ff93652524c08d"}
Jul 07 23:12:24.950939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:24.950913    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v" event={"ID":"f7c21abc-e29d-4ea8-a144-33e1a71ce69a","Type":"ContainerStarted","Data":"e5b8a7166383d2811e42058fb2a9e63007478e1b006e597e4da58e9e755a8aef"}
Jul 07 23:12:24.953565 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:24.953537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jl6ms" event={"ID":"04bad7be-83bb-4424-a30f-49d8f99e1110","Type":"ContainerStarted","Data":"4b3e994745c678c93eb2a21c39109be90e3e4384abf8d7777a4ce54dc5ccb36c"}
Jul 07 23:12:24.990795 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:24.990513    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-69h7v" podStartSLOduration=45.906667853 podStartE2EDuration="52.99048922s" totalImagesPullingTime="7.083821367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:24.983694958 +0000 UTC m=+76.203679050" watchObservedRunningTime="2026-07-07 23:12:24.99048922 +0000 UTC m=+76.210473310"
Jul 07 23:12:25.019865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.019286    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jl6ms" podStartSLOduration=16.898443872 podStartE2EDuration="28.019272221s" totalImagesPullingTime="11.120828349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:25.018890858 +0000 UTC m=+76.238874960" watchObservedRunningTime="2026-07-07 23:12:25.019272221 +0000 UTC m=+76.239256355"
Jul 07 23:12:25.960388 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.960350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vn985" event={"ID":"849cba2a-0dd1-4b10-b415-f3b69b206ff2","Type":"ContainerStarted","Data":"32148a7b64a411cc292848d1fe3b5c184caa6c9f4e40e19c11d61e81d5986ed6"}
Jul 07 23:12:25.960857 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.960480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vn985"
Jul 07 23:12:25.963339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.963112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb" event={"ID":"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0","Type":"ContainerStarted","Data":"4761e0d66394767e77f1e0f70060591ab6bbf635e4d8a2827de40826bc17c65e"}
Jul 07 23:12:25.963339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.963169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb" event={"ID":"3b31d64a-0d3a-4ff3-9d15-de7ebc0719a0","Type":"ContainerStarted","Data":"19e64f3546407249bc15e514b97d471341a7340d7d43a4b5debedb59d463224e"}
Jul 07 23:12:25.964780 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.964748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb" event={"ID":"5ea09130-18f6-4f42-9224-35f915cd3db5","Type":"ContainerStarted","Data":"d7c8090e9b033d10a40f3d246b774afa47fd91be088d18288d31d1c4f7c0c578"}
Jul 07 23:12:25.966437 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.966407    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-frvk2" event={"ID":"dd7ffe5a-2577-4511-99d8-79de623c8a52","Type":"ContainerStarted","Data":"4c5928f6f67fdbff9010d9c68d4345f15159027acc64e58915a7f09fdaf5ca9e"}
Jul 07 23:12:25.980391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.980348    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vn985" podStartSLOduration=33.968936961 podStartE2EDuration="40.980330817s" totalImagesPullingTime="7.011393856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:25.980128684 +0000 UTC m=+77.200112769" watchObservedRunningTime="2026-07-07 23:12:25.980330817 +0000 UTC m=+77.200314907"
Jul 07 23:12:25.997206 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:25.997160    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-frvk2" podStartSLOduration=68.221932292 podStartE2EDuration="1m15.997149816s" totalImagesPullingTime="7.775217524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:25.995877044 +0000 UTC m=+77.215861136" watchObservedRunningTime="2026-07-07 23:12:25.997149816 +0000 UTC m=+77.217133906"
Jul 07 23:12:26.010906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:26.010850    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sksvb" podStartSLOduration=47.023213782 podStartE2EDuration="54.010834297s" totalImagesPullingTime="6.987620515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:26.010462003 +0000 UTC m=+77.230446092" watchObservedRunningTime="2026-07-07 23:12:26.010834297 +0000 UTC m=+77.230818387"
Jul 07 23:12:26.026401 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:26.026364    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nnkgb" podStartSLOduration=47.00153371 podStartE2EDuration="54.026352188s" totalImagesPullingTime="7.024818478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:26.02569741 +0000 UTC m=+77.245681502" watchObservedRunningTime="2026-07-07 23:12:26.026352188 +0000 UTC m=+77.246336302"
Jul 07 23:12:27.932180 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:27.932144    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66fcb84fd7-c4lm4"]
Jul 07 23:12:28.015221 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.015191    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fcb84fd7-c4lm4"]
Jul 07 23:12:28.015369 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.015281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.024153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.024094    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 23:12:28.124706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.124675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-trusted-ca-bundle\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.124871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.124717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-serving-cert\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.124871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.124781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-config\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.124871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.124820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qlrh\" (UniqueName: \"kubernetes.io/projected/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-kube-api-access-8qlrh\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.124871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.124861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-oauth-serving-cert\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.125024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.124882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-service-ca\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.125024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.124899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-oauth-config\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.225814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.225743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-trusted-ca-bundle\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.225814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.225783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-serving-cert\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.225814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.225803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-config\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.225820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qlrh\" (UniqueName: \"kubernetes.io/projected/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-kube-api-access-8qlrh\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.225843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-oauth-serving-cert\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.225862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-service-ca\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.225880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-oauth-config\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226592 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.226567    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-config\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226738 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.226716    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-oauth-serving-cert\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226781 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.226767    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-trusted-ca-bundle\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.226815 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.226760    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-service-ca\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.228353 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.228326    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-oauth-config\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.228436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.228375    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-serving-cert\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.235809 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.235791    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qlrh\" (UniqueName: \"kubernetes.io/projected/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-kube-api-access-8qlrh\") pod \"console-66fcb84fd7-c4lm4\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") " pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.324967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.324930    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:28.492759 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.492734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fcb84fd7-c4lm4"]
Jul 07 23:12:28.495750 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:28.495728    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ff662b_efaf_47ce_80d5_ad1d1f9f6118.slice/crio-2067ff29a05d662f4207fdd20059097349c2ebc9f49fbb914860310bd3c091ea WatchSource:0}: Error finding container 2067ff29a05d662f4207fdd20059097349c2ebc9f49fbb914860310bd3c091ea: Status 404 returned error can't find the container with id 2067ff29a05d662f4207fdd20059097349c2ebc9f49fbb914860310bd3c091ea
Jul 07 23:12:28.979483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.979444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66df6fd7f4-7zjsn" event={"ID":"e59c045d-40d0-423f-90e9-459b0c2ea094","Type":"ContainerStarted","Data":"b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69"}
Jul 07 23:12:28.980853 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.980830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcb84fd7-c4lm4" event={"ID":"33ff662b-efaf-47ce-80d5-ad1d1f9f6118","Type":"ContainerStarted","Data":"0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226"}
Jul 07 23:12:28.980977 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.980865    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcb84fd7-c4lm4" event={"ID":"33ff662b-efaf-47ce-80d5-ad1d1f9f6118","Type":"ContainerStarted","Data":"2067ff29a05d662f4207fdd20059097349c2ebc9f49fbb914860310bd3c091ea"}
Jul 07 23:12:28.997082 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:28.997042    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66df6fd7f4-7zjsn" podStartSLOduration=2.487514873 podStartE2EDuration="5.997029895s" totalImagesPullingTime="3.509515022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:28.995838461 +0000 UTC m=+80.215822549" watchObservedRunningTime="2026-07-07 23:12:28.997029895 +0000 UTC m=+80.217013984"
Jul 07 23:12:29.014443 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:29.014404    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66fcb84fd7-c4lm4" podStartSLOduration=2.014391382 podStartE2EDuration="2.014391382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:29.013601407 +0000 UTC m=+80.233585497" watchObservedRunningTime="2026-07-07 23:12:29.014391382 +0000 UTC m=+80.234375470"
Jul 07 23:12:33.996177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:33.996016    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:33.996177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:33.996117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:34.001029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:34.001004    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:35.006668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:35.006640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:12:35.973427 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:35.973398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vn985"
Jul 07 23:12:36.356499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.356469    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"]
Jul 07 23:12:36.359347 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.359329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.362834 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.362808    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 23:12:36.363002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.362937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 23:12:36.363092 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.363044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bs9lc\""
Jul 07 23:12:36.364016 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.364000    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 23:12:36.378944 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.376661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"]
Jul 07 23:12:36.495219 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.495182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b34cffc4-0aee-41a6-8592-6743a8869d8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.495219 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.495223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b34cffc4-0aee-41a6-8592-6743a8869d8c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.495412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.495248    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b34cffc4-0aee-41a6-8592-6743a8869d8c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.495412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.495318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6nwf\" (UniqueName: \"kubernetes.io/projected/b34cffc4-0aee-41a6-8592-6743a8869d8c-kube-api-access-h6nwf\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.596423 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.596392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6nwf\" (UniqueName: \"kubernetes.io/projected/b34cffc4-0aee-41a6-8592-6743a8869d8c-kube-api-access-h6nwf\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.596616 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.596453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b34cffc4-0aee-41a6-8592-6743a8869d8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.596616 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.596590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b34cffc4-0aee-41a6-8592-6743a8869d8c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.596728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.596629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b34cffc4-0aee-41a6-8592-6743a8869d8c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.597266 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.597244    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b34cffc4-0aee-41a6-8592-6743a8869d8c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.598869 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.598848    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b34cffc4-0aee-41a6-8592-6743a8869d8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.598969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.598866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b34cffc4-0aee-41a6-8592-6743a8869d8c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.610223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.610165    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6nwf\" (UniqueName: \"kubernetes.io/projected/b34cffc4-0aee-41a6-8592-6743a8869d8c-kube-api-access-h6nwf\") pod \"prometheus-operator-567f7b8b7c-b9dtl\" (UID: \"b34cffc4-0aee-41a6-8592-6743a8869d8c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.668072 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.668044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"
Jul 07 23:12:36.807729 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:36.807702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl"]
Jul 07 23:12:36.810230 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:36.810203    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34cffc4_0aee_41a6_8592_6743a8869d8c.slice/crio-d530d44174f895180560b908d68ab166ae09943ff4210bf4ead83566ab4fc48a WatchSource:0}: Error finding container d530d44174f895180560b908d68ab166ae09943ff4210bf4ead83566ab4fc48a: Status 404 returned error can't find the container with id d530d44174f895180560b908d68ab166ae09943ff4210bf4ead83566ab4fc48a
Jul 07 23:12:37.011126 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:37.011034    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl" event={"ID":"b34cffc4-0aee-41a6-8592-6743a8869d8c","Type":"ContainerStarted","Data":"d530d44174f895180560b908d68ab166ae09943ff4210bf4ead83566ab4fc48a"}
Jul 07 23:12:38.325262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:38.325230    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:38.325714 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:38.325296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:38.330219 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:38.330197    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:38.923556 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:38.923526    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:12:39.020155 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:39.020093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl" event={"ID":"b34cffc4-0aee-41a6-8592-6743a8869d8c","Type":"ContainerStarted","Data":"fc4486f2f5792d5e52a770a7ec6c5c6245e59d40a92312b364eb581ba0c7f0c1"}
Jul 07 23:12:39.020319 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:39.020175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl" event={"ID":"b34cffc4-0aee-41a6-8592-6743a8869d8c","Type":"ContainerStarted","Data":"520980d8ef91318c6dcba1b9b9a36a372aa00fedf586508f1a0473f907986608"}
Jul 07 23:12:39.023938 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:39.023916    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:12:39.041079 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:39.041035    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-b9dtl" podStartSLOduration=1.507902061 podStartE2EDuration="3.04102096s" totalImagesPullingTime="1.533118899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:39.039752262 +0000 UTC m=+90.259736352" watchObservedRunningTime="2026-07-07 23:12:39.04102096 +0000 UTC m=+90.261005049"
Jul 07 23:12:39.124040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:39.124012    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66df6fd7f4-7zjsn"]
Jul 07 23:12:40.897590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.897552    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-svjvw"]
Jul 07 23:12:40.899963 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.899944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.904418 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.904396    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 23:12:40.904418 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.904410    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 23:12:40.904565 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.904411    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 23:12:40.904565 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.904413    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s7wx8\""
Jul 07 23:12:40.934290 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-wtmp\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-textfile\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7x7\" (UniqueName: \"kubernetes.io/projected/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-kube-api-access-2g7x7\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-tls\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-root\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-metrics-client-ca\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:40.934557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:40.934502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-sys\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035365 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035365 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-wtmp\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035563 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-textfile\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035563 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7x7\" (UniqueName: \"kubernetes.io/projected/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-kube-api-access-2g7x7\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035563 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-wtmp\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-tls\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-root\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-metrics-client-ca\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035877 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-sys\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035877 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-root\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035877 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035722    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-textfile\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.035877 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.035822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-sys\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.036262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.036240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-metrics-client-ca\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.036314 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.036266    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.037868 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.037846    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-tls\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.038021 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.038006    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.047878 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.047850    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7x7\" (UniqueName: \"kubernetes.io/projected/73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a-kube-api-access-2g7x7\") pod \"node-exporter-svjvw\" (UID: \"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a\") " pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.209185 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:41.209057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-svjvw"
Jul 07 23:12:41.219015 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:41.218992    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dbfc24_13c5_4b99_b5dc_a00d2ab7fb7a.slice/crio-279c227251f0886134d48200d1ea72414ceca40f15e10698ed0f5cd75927deeb WatchSource:0}: Error finding container 279c227251f0886134d48200d1ea72414ceca40f15e10698ed0f5cd75927deeb: Status 404 returned error can't find the container with id 279c227251f0886134d48200d1ea72414ceca40f15e10698ed0f5cd75927deeb
Jul 07 23:12:42.034905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:42.034866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svjvw" event={"ID":"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a","Type":"ContainerStarted","Data":"279c227251f0886134d48200d1ea72414ceca40f15e10698ed0f5cd75927deeb"}
Jul 07 23:12:43.039862 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.039826    2581 generic.go:356] "Generic (PLEG): container finished" podID="73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a" containerID="e1345382f43dc273046884b9cad94853525426bc1292b621ab5f09aa3975cef8" exitCode=0
Jul 07 23:12:43.040256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.039868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svjvw" event={"ID":"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a","Type":"ContainerDied","Data":"e1345382f43dc273046884b9cad94853525426bc1292b621ab5f09aa3975cef8"}
Jul 07 23:12:43.940389 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.940352    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"]
Jul 07 23:12:43.943033 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.943016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.945836 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.945809    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 23:12:43.945931 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.945917    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bli02lp61dnt3\""
Jul 07 23:12:43.947162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.947141    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 23:12:43.947162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.947142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 23:12:43.947319 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.947197    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 23:12:43.947319 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.947287    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 23:12:43.948014 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.947998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tzb7r\""
Jul 07 23:12:43.957609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.957707 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7v9\" (UniqueName: \"kubernetes.io/projected/e6ab011a-d6fc-40bf-b825-beb963924b12-kube-api-access-bw7v9\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.957707 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab011a-d6fc-40bf-b825-beb963924b12-metrics-client-ca\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.957860 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.957860 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.957860 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-grpc-tls\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.957994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-tls\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.957994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.957961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:43.959245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:43.959224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"]
Jul 07 23:12:44.045237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.045202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svjvw" event={"ID":"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a","Type":"ContainerStarted","Data":"ac4bd86de89a4cc58bea01ce44c66abc92dd409fbf6ea9a956cf1ce34d59ca64"}
Jul 07 23:12:44.045623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.045263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svjvw" event={"ID":"73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a","Type":"ContainerStarted","Data":"f9a9760c97731f0057bf8cd75fa99cf171db7fc48108bf2b415e920d00a18d88"}
Jul 07 23:12:44.059072 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.059229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.059229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7v9\" (UniqueName: \"kubernetes.io/projected/e6ab011a-d6fc-40bf-b825-beb963924b12-kube-api-access-bw7v9\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.059332 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab011a-d6fc-40bf-b825-beb963924b12-metrics-client-ca\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.059332 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.059424 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.059424 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-grpc-tls\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.059424 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.059400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-tls\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.060043 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.060012    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab011a-d6fc-40bf-b825-beb963924b12-metrics-client-ca\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.062223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.062182    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.062352 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.062249    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.062425 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.062401    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-grpc-tls\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.062518 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.062497    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.062567 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.062522    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-tls\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.062725 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.062707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e6ab011a-d6fc-40bf-b825-beb963924b12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.070152 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.070091    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-svjvw" podStartSLOduration=2.8099096059999997 podStartE2EDuration="4.070078888s" totalImagesPullingTime="1.197087546s" totalInitContainerRuntime="63.081736ms" isStatefulPod=true podCreationTimestamp="2026-07-07 23:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:44.067888686 +0000 UTC m=+95.287872776" watchObservedRunningTime="2026-07-07 23:12:44.070078888 +0000 UTC m=+95.290062977"
Jul 07 23:12:44.071600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.071578    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7v9\" (UniqueName: \"kubernetes.io/projected/e6ab011a-d6fc-40bf-b825-beb963924b12-kube-api-access-bw7v9\") pod \"thanos-querier-85747cbbb8-2hm8h\" (UID: \"e6ab011a-d6fc-40bf-b825-beb963924b12\") " pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.252877 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.252785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:44.390019 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:44.389993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"]
Jul 07 23:12:44.391937 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:44.391912    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ab011a_d6fc_40bf_b825_beb963924b12.slice/crio-9fe929803a57792d9c338464e8ea2c468348af79c0df7f2f23d4f5d82628ffb4 WatchSource:0}: Error finding container 9fe929803a57792d9c338464e8ea2c468348af79c0df7f2f23d4f5d82628ffb4: Status 404 returned error can't find the container with id 9fe929803a57792d9c338464e8ea2c468348af79c0df7f2f23d4f5d82628ffb4
Jul 07 23:12:45.050276 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.050239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" event={"ID":"e6ab011a-d6fc-40bf-b825-beb963924b12","Type":"ContainerStarted","Data":"9fe929803a57792d9c338464e8ea2c468348af79c0df7f2f23d4f5d82628ffb4"}
Jul 07 23:12:45.530304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.530220    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"]
Jul 07 23:12:45.532766 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.532747    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.537021 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.536998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 23:12:45.537177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.537157    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dmkbt\""
Jul 07 23:12:45.553123 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.553078    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"]
Jul 07 23:12:45.571702 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.571673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6np7\" (UniqueName: \"kubernetes.io/projected/2d77f865-d067-44c5-91aa-5c58e6e2aaef-kube-api-access-x6np7\") pod \"monitoring-plugin-d5dcff7cf-spt22\" (UID: \"2d77f865-d067-44c5-91aa-5c58e6e2aaef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.571806 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.571725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d77f865-d067-44c5-91aa-5c58e6e2aaef-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-spt22\" (UID: \"2d77f865-d067-44c5-91aa-5c58e6e2aaef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.673237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.673203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6np7\" (UniqueName: \"kubernetes.io/projected/2d77f865-d067-44c5-91aa-5c58e6e2aaef-kube-api-access-x6np7\") pod \"monitoring-plugin-d5dcff7cf-spt22\" (UID: \"2d77f865-d067-44c5-91aa-5c58e6e2aaef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.673364 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.673279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d77f865-d067-44c5-91aa-5c58e6e2aaef-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-spt22\" (UID: \"2d77f865-d067-44c5-91aa-5c58e6e2aaef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.678610 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.678583    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d77f865-d067-44c5-91aa-5c58e6e2aaef-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-spt22\" (UID: \"2d77f865-d067-44c5-91aa-5c58e6e2aaef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.690850 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.690805    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6np7\" (UniqueName: \"kubernetes.io/projected/2d77f865-d067-44c5-91aa-5c58e6e2aaef-kube-api-access-x6np7\") pod \"monitoring-plugin-d5dcff7cf-spt22\" (UID: \"2d77f865-d067-44c5-91aa-5c58e6e2aaef\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.844202 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.844169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:45.994154 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:45.993972    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"]
Jul 07 23:12:45.997051 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:45.997017    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d77f865_d067_44c5_91aa_5c58e6e2aaef.slice/crio-9e8e67a69bf595a6d194f5a13ea91ebad48123244b9b45c954816f8d01525efa WatchSource:0}: Error finding container 9e8e67a69bf595a6d194f5a13ea91ebad48123244b9b45c954816f8d01525efa: Status 404 returned error can't find the container with id 9e8e67a69bf595a6d194f5a13ea91ebad48123244b9b45c954816f8d01525efa
Jul 07 23:12:46.056273 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:46.056237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22" event={"ID":"2d77f865-d067-44c5-91aa-5c58e6e2aaef","Type":"ContainerStarted","Data":"9e8e67a69bf595a6d194f5a13ea91ebad48123244b9b45c954816f8d01525efa"}
Jul 07 23:12:46.084397 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:46.084358    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687b8d59fc-d8wzr"]
Jul 07 23:12:47.179945 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.179912    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd74959c5-8jdpc"]
Jul 07 23:12:47.201311 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.201287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.229447 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.229419    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd74959c5-8jdpc"]
Jul 07 23:12:47.287355 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.287321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-trusted-ca-bundle\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.287355 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.287354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-serving-cert\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.287561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.287392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-oauth-config\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.287561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.287478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59bwz\" (UniqueName: \"kubernetes.io/projected/114da80c-5167-4fe2-a260-d73d8b28850e-kube-api-access-59bwz\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.287561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.287538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-service-ca\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.287701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.287570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-console-config\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.287701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.287597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-oauth-serving-cert\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.388985 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.388945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-trusted-ca-bundle\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.388985 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.388988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-serving-cert\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.389259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-oauth-config\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.389259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59bwz\" (UniqueName: \"kubernetes.io/projected/114da80c-5167-4fe2-a260-d73d8b28850e-kube-api-access-59bwz\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.389259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-service-ca\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.389259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-console-config\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.389259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-oauth-serving-cert\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.389880 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-service-ca\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.390003 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389889    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-trusted-ca-bundle\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.390003 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.389975    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-console-config\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.390092 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.390017    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-oauth-serving-cert\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.391590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.391554    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-oauth-config\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.391725 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.391707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-serving-cert\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.412496 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.412473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59bwz\" (UniqueName: \"kubernetes.io/projected/114da80c-5167-4fe2-a260-d73d8b28850e-kube-api-access-59bwz\") pod \"console-5bd74959c5-8jdpc\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") " pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.512027 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.511998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:47.732135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:47.732092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd74959c5-8jdpc"]
Jul 07 23:12:47.738410 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:12:47.738377    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114da80c_5167_4fe2_a260_d73d8b28850e.slice/crio-3b372e5760e9d93d477771e994e29fb2b5d5c459818d4c31eabf6dd11e6d6103 WatchSource:0}: Error finding container 3b372e5760e9d93d477771e994e29fb2b5d5c459818d4c31eabf6dd11e6d6103: Status 404 returned error can't find the container with id 3b372e5760e9d93d477771e994e29fb2b5d5c459818d4c31eabf6dd11e6d6103
Jul 07 23:12:48.068561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:48.068519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74959c5-8jdpc" event={"ID":"114da80c-5167-4fe2-a260-d73d8b28850e","Type":"ContainerStarted","Data":"c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f"}
Jul 07 23:12:48.068753 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:48.068583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74959c5-8jdpc" event={"ID":"114da80c-5167-4fe2-a260-d73d8b28850e","Type":"ContainerStarted","Data":"3b372e5760e9d93d477771e994e29fb2b5d5c459818d4c31eabf6dd11e6d6103"}
Jul 07 23:12:48.070905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:48.070878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" event={"ID":"e6ab011a-d6fc-40bf-b825-beb963924b12","Type":"ContainerStarted","Data":"a251cbae4379401b6161fe95e9405844c0012cb2d4b28efa9734f284561a2f4c"}
Jul 07 23:12:48.071015 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:48.070939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" event={"ID":"e6ab011a-d6fc-40bf-b825-beb963924b12","Type":"ContainerStarted","Data":"39d712d92fe15c0c02540a66c771fb2054c8b5f78d39cea273ff85cb95c85ba9"}
Jul 07 23:12:48.071015 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:48.070968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" event={"ID":"e6ab011a-d6fc-40bf-b825-beb963924b12","Type":"ContainerStarted","Data":"d2fae514c0b11d165abe392d7f2490397d8a8be1fb9b6bedaee713ba5aa04591"}
Jul 07 23:12:48.097488 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:48.097436    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bd74959c5-8jdpc" podStartSLOduration=1.097417519 podStartE2EDuration="1.097417519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:48.096134126 +0000 UTC m=+99.316118214" watchObservedRunningTime="2026-07-07 23:12:48.097417519 +0000 UTC m=+99.317401611"
Jul 07 23:12:49.077352 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:49.077321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" event={"ID":"e6ab011a-d6fc-40bf-b825-beb963924b12","Type":"ContainerStarted","Data":"7f0d88a65fdc1e239a99c102b6ca0d1f7cbbd1693b9de4fa569cf64bbf388c66"}
Jul 07 23:12:49.078816 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:49.078793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22" event={"ID":"2d77f865-d067-44c5-91aa-5c58e6e2aaef","Type":"ContainerStarted","Data":"0ae85ab89361ca2ef1fa7ff0854c7a886f5fed4b081a6c73adaa19ddc3c1ec5b"}
Jul 07 23:12:49.102472 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:49.102419    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22" podStartSLOduration=1.637245848 podStartE2EDuration="4.102399145s" totalImagesPullingTime="2.465153297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:49.101307 +0000 UTC m=+100.321291157" watchObservedRunningTime="2026-07-07 23:12:49.102399145 +0000 UTC m=+100.322383237"
Jul 07 23:12:49.927351 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:49.927324    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pbj79"
Jul 07 23:12:50.085230 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:50.085195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" event={"ID":"e6ab011a-d6fc-40bf-b825-beb963924b12","Type":"ContainerStarted","Data":"0f84773273b2a8fd147b5585bd2e8b99ffb0bb6e26bc5c060b6a83db509d3cf5"}
Jul 07 23:12:50.085664 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:50.085262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" event={"ID":"e6ab011a-d6fc-40bf-b825-beb963924b12","Type":"ContainerStarted","Data":"9777ef00461cb11dc142b7c0eb586a73aca3d121c49876d5c1e72163e05ec87a"}
Jul 07 23:12:50.085664 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:50.085324    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:50.090487 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:50.090461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-spt22"
Jul 07 23:12:50.111310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:50.111262    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h" podStartSLOduration=2.892821118 podStartE2EDuration="7.111246626s" totalImagesPullingTime="4.218425508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:50.109165344 +0000 UTC m=+101.329149437" watchObservedRunningTime="2026-07-07 23:12:50.111246626 +0000 UTC m=+101.331230753"
Jul 07 23:12:51.089740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:51.089711    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:52.100761 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:52.100735    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85747cbbb8-2hm8h"
Jul 07 23:12:57.512536 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:57.512505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:57.512972 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:57.512549    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:57.517310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:57.517286    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:58.126075 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:58.126047    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:12:58.176201 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:12:58.176165    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66fcb84fd7-c4lm4"]
Jul 07 23:13:04.144683 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.144639    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66df6fd7f4-7zjsn" podUID="e59c045d-40d0-423f-90e9-459b0c2ea094" containerName="console" containerID="cri-o://b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69" gracePeriod=15
Jul 07 23:13:04.387030 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.387006    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:13:04.429981 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.429922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-oauth-serving-cert\") pod \"e59c045d-40d0-423f-90e9-459b0c2ea094\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") "
Jul 07 23:13:04.429981 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.429954    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-console-config\") pod \"e59c045d-40d0-423f-90e9-459b0c2ea094\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") "
Jul 07 23:13:04.429981 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.429978    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-oauth-config\") pod \"e59c045d-40d0-423f-90e9-459b0c2ea094\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") "
Jul 07 23:13:04.430218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.430022    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-serving-cert\") pod \"e59c045d-40d0-423f-90e9-459b0c2ea094\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") "
Jul 07 23:13:04.430218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.430051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-service-ca\") pod \"e59c045d-40d0-423f-90e9-459b0c2ea094\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") "
Jul 07 23:13:04.430218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.430090    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rs8f\" (UniqueName: \"kubernetes.io/projected/e59c045d-40d0-423f-90e9-459b0c2ea094-kube-api-access-4rs8f\") pod \"e59c045d-40d0-423f-90e9-459b0c2ea094\" (UID: \"e59c045d-40d0-423f-90e9-459b0c2ea094\") "
Jul 07 23:13:04.430421 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.430364    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-console-config" (OuterVolumeSpecName: "console-config") pod "e59c045d-40d0-423f-90e9-459b0c2ea094" (UID: "e59c045d-40d0-423f-90e9-459b0c2ea094"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:04.430549 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.430471    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e59c045d-40d0-423f-90e9-459b0c2ea094" (UID: "e59c045d-40d0-423f-90e9-459b0c2ea094"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:04.430549 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.430489    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-service-ca" (OuterVolumeSpecName: "service-ca") pod "e59c045d-40d0-423f-90e9-459b0c2ea094" (UID: "e59c045d-40d0-423f-90e9-459b0c2ea094"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:04.432425 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.432392    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e59c045d-40d0-423f-90e9-459b0c2ea094" (UID: "e59c045d-40d0-423f-90e9-459b0c2ea094"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:13:04.432534 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.432497    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e59c045d-40d0-423f-90e9-459b0c2ea094" (UID: "e59c045d-40d0-423f-90e9-459b0c2ea094"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:13:04.432599 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.432548    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59c045d-40d0-423f-90e9-459b0c2ea094-kube-api-access-4rs8f" (OuterVolumeSpecName: "kube-api-access-4rs8f") pod "e59c045d-40d0-423f-90e9-459b0c2ea094" (UID: "e59c045d-40d0-423f-90e9-459b0c2ea094"). InnerVolumeSpecName "kube-api-access-4rs8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:13:04.531164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.531129    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-oauth-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:04.531164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.531156    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-console-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:04.531164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.531168    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-oauth-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:04.531390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.531178    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e59c045d-40d0-423f-90e9-459b0c2ea094-console-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:04.531390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.531186    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e59c045d-40d0-423f-90e9-459b0c2ea094-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:04.531390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:04.531195    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rs8f\" (UniqueName: \"kubernetes.io/projected/e59c045d-40d0-423f-90e9-459b0c2ea094-kube-api-access-4rs8f\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:05.152636 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.152602    2581 generic.go:356] "Generic (PLEG): container finished" podID="e59c045d-40d0-423f-90e9-459b0c2ea094" containerID="b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69" exitCode=0
Jul 07 23:13:05.153006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.152641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66df6fd7f4-7zjsn" event={"ID":"e59c045d-40d0-423f-90e9-459b0c2ea094","Type":"ContainerDied","Data":"b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69"}
Jul 07 23:13:05.153006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.152659    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66df6fd7f4-7zjsn"
Jul 07 23:13:05.153006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.152704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66df6fd7f4-7zjsn" event={"ID":"e59c045d-40d0-423f-90e9-459b0c2ea094","Type":"ContainerDied","Data":"6d25f15882d9830d0d79dd4d1e644a30c6513f26f11abcf818ff93652524c08d"}
Jul 07 23:13:05.153006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.152723    2581 scope.go:117] "RemoveContainer" containerID="b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69"
Jul 07 23:13:05.161724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.161704    2581 scope.go:117] "RemoveContainer" containerID="b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69"
Jul 07 23:13:05.161989 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:13:05.161969    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69\": container with ID starting with b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69 not found: ID does not exist" containerID="b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69"
Jul 07 23:13:05.162068 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.161995    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69"} err="failed to get container status \"b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69\": rpc error: code = NotFound desc = could not find container \"b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69\": container with ID starting with b6ca80137c48d3b7b0e223242f28a2ad3e5cb706e3d2e366b237a17410b01b69 not found: ID does not exist"
Jul 07 23:13:05.177788 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.177761    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66df6fd7f4-7zjsn"]
Jul 07 23:13:05.181966 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.181943    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66df6fd7f4-7zjsn"]
Jul 07 23:13:05.503067 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:05.502992    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59c045d-40d0-423f-90e9-459b0c2ea094" path="/var/lib/kubelet/pods/e59c045d-40d0-423f-90e9-459b0c2ea094/volumes"
Jul 07 23:13:11.109423 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.109385    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr" podUID="4e27321e-5392-42d1-92db-134a78bdd828" containerName="registry" containerID="cri-o://c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db" gracePeriod=30
Jul 07 23:13:11.342710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.342683    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:13:11.490391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490310    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcfjn\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-kube-api-access-dcfjn\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.490391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490344    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-bound-sa-token\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.490391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.490391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490392    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-installation-pull-secrets\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.490696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490448    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e27321e-5392-42d1-92db-134a78bdd828-ca-trust-extracted\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.490696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-registry-certificates\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.490696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490517    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-image-registry-private-configuration\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.490696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.490563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-trusted-ca\") pod \"4e27321e-5392-42d1-92db-134a78bdd828\" (UID: \"4e27321e-5392-42d1-92db-134a78bdd828\") "
Jul 07 23:13:11.491041 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.491003    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:11.491209 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.491170    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:11.493336 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.493303    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-kube-api-access-dcfjn" (OuterVolumeSpecName: "kube-api-access-dcfjn") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "kube-api-access-dcfjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:13:11.494999 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.494971    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:13:11.495087 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.494997    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:13:11.495087 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.495053    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:13:11.495198 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.495079    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:13:11.502695 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.502669    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e27321e-5392-42d1-92db-134a78bdd828-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4e27321e-5392-42d1-92db-134a78bdd828" (UID: "4e27321e-5392-42d1-92db-134a78bdd828"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:13:11.591663 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591619    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-registry-certificates\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:11.591663 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591654    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-image-registry-private-configuration\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:11.591663 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591665    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e27321e-5392-42d1-92db-134a78bdd828-trusted-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:11.591663 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591674    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcfjn\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-kube-api-access-dcfjn\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:11.591905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591683    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-bound-sa-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:11.591905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591691    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e27321e-5392-42d1-92db-134a78bdd828-registry-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:11.591905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591699    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e27321e-5392-42d1-92db-134a78bdd828-installation-pull-secrets\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:11.591905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:11.591712    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e27321e-5392-42d1-92db-134a78bdd828-ca-trust-extracted\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:12.179903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.179868    2581 generic.go:356] "Generic (PLEG): container finished" podID="4e27321e-5392-42d1-92db-134a78bdd828" containerID="c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db" exitCode=0
Jul 07 23:13:12.180403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.179917    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr"
Jul 07 23:13:12.180403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.179954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr" event={"ID":"4e27321e-5392-42d1-92db-134a78bdd828","Type":"ContainerDied","Data":"c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db"}
Jul 07 23:13:12.180403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.180015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687b8d59fc-d8wzr" event={"ID":"4e27321e-5392-42d1-92db-134a78bdd828","Type":"ContainerDied","Data":"9e382514acad13a4641a271656992bb212b776037177080a8d3330133362e470"}
Jul 07 23:13:12.180403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.180046    2581 scope.go:117] "RemoveContainer" containerID="c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db"
Jul 07 23:13:12.181580 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.181560    2581 generic.go:356] "Generic (PLEG): container finished" podID="901604ec-d101-44ac-a0b8-ef3230d3c972" containerID="6c024d12321d7dec587397c1b41b7cf81d3cbc95e59fdd2853ce3070b2da3529" exitCode=0
Jul 07 23:13:12.181656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.181594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj" event={"ID":"901604ec-d101-44ac-a0b8-ef3230d3c972","Type":"ContainerDied","Data":"6c024d12321d7dec587397c1b41b7cf81d3cbc95e59fdd2853ce3070b2da3529"}
Jul 07 23:13:12.181886 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.181872    2581 scope.go:117] "RemoveContainer" containerID="6c024d12321d7dec587397c1b41b7cf81d3cbc95e59fdd2853ce3070b2da3529"
Jul 07 23:13:12.197263 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.197244    2581 scope.go:117] "RemoveContainer" containerID="c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db"
Jul 07 23:13:12.197529 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:13:12.197509    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db\": container with ID starting with c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db not found: ID does not exist" containerID="c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db"
Jul 07 23:13:12.197593 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.197536    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db"} err="failed to get container status \"c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db\": rpc error: code = NotFound desc = could not find container \"c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db\": container with ID starting with c3ad5eff634f53b108b15448f88cb112a34140ad53cc75161d8f20409af0c7db not found: ID does not exist"
Jul 07 23:13:12.233341 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.233302    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687b8d59fc-d8wzr"]
Jul 07 23:13:12.239714 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.239683    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-687b8d59fc-d8wzr"]
Jul 07 23:13:12.871659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.871628    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d8c8946bf-skgkk_7fe35cca-ab40-4105-ad17-eff2a9ecef1c/router/0.log"
Jul 07 23:13:12.918578 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:12.918551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgnw5_9a5affdc-9b21-48a5-b731-1092e540e3f4/serve-healthcheck-canary/0.log"
Jul 07 23:13:13.187474 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:13.187401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ltgrj" event={"ID":"901604ec-d101-44ac-a0b8-ef3230d3c972","Type":"ContainerStarted","Data":"3888eced2354616151e55c0752050daae03b31e600d16493fa8fd37133a7d74c"}
Jul 07 23:13:13.501973 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:13.501901    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e27321e-5392-42d1-92db-134a78bdd828" path="/var/lib/kubelet/pods/4e27321e-5392-42d1-92db-134a78bdd828/volumes"
Jul 07 23:13:23.198582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.198511    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66fcb84fd7-c4lm4" podUID="33ff662b-efaf-47ce-80d5-ad1d1f9f6118" containerName="console" containerID="cri-o://0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226" gracePeriod=15
Jul 07 23:13:23.461023 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.460968    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:13:23.591814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.591785    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-oauth-config\") pod \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") "
Jul 07 23:13:23.591997 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.591832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-serving-cert\") pod \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") "
Jul 07 23:13:23.591997 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.591880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-service-ca\") pod \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") "
Jul 07 23:13:23.591997 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.591930    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-config\") pod \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") "
Jul 07 23:13:23.591997 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.591948    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-oauth-serving-cert\") pod \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") "
Jul 07 23:13:23.591997 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.591985    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-trusted-ca-bundle\") pod \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") "
Jul 07 23:13:23.592284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.592011    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qlrh\" (UniqueName: \"kubernetes.io/projected/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-kube-api-access-8qlrh\") pod \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\" (UID: \"33ff662b-efaf-47ce-80d5-ad1d1f9f6118\") "
Jul 07 23:13:23.592353 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.592291    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-service-ca" (OuterVolumeSpecName: "service-ca") pod "33ff662b-efaf-47ce-80d5-ad1d1f9f6118" (UID: "33ff662b-efaf-47ce-80d5-ad1d1f9f6118"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:23.592584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.592559    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "33ff662b-efaf-47ce-80d5-ad1d1f9f6118" (UID: "33ff662b-efaf-47ce-80d5-ad1d1f9f6118"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:23.592705 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.592683    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:23.592769 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.592713    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-oauth-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:23.592769 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.592734    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "33ff662b-efaf-47ce-80d5-ad1d1f9f6118" (UID: "33ff662b-efaf-47ce-80d5-ad1d1f9f6118"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:23.592911 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.592885    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-config" (OuterVolumeSpecName: "console-config") pod "33ff662b-efaf-47ce-80d5-ad1d1f9f6118" (UID: "33ff662b-efaf-47ce-80d5-ad1d1f9f6118"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:13:23.594082 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.594053    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "33ff662b-efaf-47ce-80d5-ad1d1f9f6118" (UID: "33ff662b-efaf-47ce-80d5-ad1d1f9f6118"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:13:23.594082 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.594066    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "33ff662b-efaf-47ce-80d5-ad1d1f9f6118" (UID: "33ff662b-efaf-47ce-80d5-ad1d1f9f6118"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:13:23.594527 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.594495    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-kube-api-access-8qlrh" (OuterVolumeSpecName: "kube-api-access-8qlrh") pod "33ff662b-efaf-47ce-80d5-ad1d1f9f6118" (UID: "33ff662b-efaf-47ce-80d5-ad1d1f9f6118"). InnerVolumeSpecName "kube-api-access-8qlrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:13:23.693964 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.693923    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-oauth-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:23.693964 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.693954    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:23.693964 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.693964    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-console-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:23.693964 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.693972    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-trusted-ca-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:23.694218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:23.693981    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qlrh\" (UniqueName: \"kubernetes.io/projected/33ff662b-efaf-47ce-80d5-ad1d1f9f6118-kube-api-access-8qlrh\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:13:24.231020 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.230987    2581 generic.go:356] "Generic (PLEG): container finished" podID="33ff662b-efaf-47ce-80d5-ad1d1f9f6118" containerID="0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226" exitCode=0
Jul 07 23:13:24.231483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.231032    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcb84fd7-c4lm4"
Jul 07 23:13:24.231483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.231067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcb84fd7-c4lm4" event={"ID":"33ff662b-efaf-47ce-80d5-ad1d1f9f6118","Type":"ContainerDied","Data":"0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226"}
Jul 07 23:13:24.231483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.231132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcb84fd7-c4lm4" event={"ID":"33ff662b-efaf-47ce-80d5-ad1d1f9f6118","Type":"ContainerDied","Data":"2067ff29a05d662f4207fdd20059097349c2ebc9f49fbb914860310bd3c091ea"}
Jul 07 23:13:24.231483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.231156    2581 scope.go:117] "RemoveContainer" containerID="0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226"
Jul 07 23:13:24.240966 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.240950    2581 scope.go:117] "RemoveContainer" containerID="0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226"
Jul 07 23:13:24.241232 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:13:24.241215    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226\": container with ID starting with 0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226 not found: ID does not exist" containerID="0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226"
Jul 07 23:13:24.241296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.241244    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226"} err="failed to get container status \"0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226\": rpc error: code = NotFound desc = could not find container \"0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226\": container with ID starting with 0d567802684377be9efcd7bf4640fdc34f905654e47ff1c4ef62359ad9b20226 not found: ID does not exist"
Jul 07 23:13:24.258793 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.258759    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66fcb84fd7-c4lm4"]
Jul 07 23:13:24.265004 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:24.264971    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66fcb84fd7-c4lm4"]
Jul 07 23:13:25.503038 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:25.503009    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33ff662b-efaf-47ce-80d5-ad1d1f9f6118" path="/var/lib/kubelet/pods/33ff662b-efaf-47ce-80d5-ad1d1f9f6118/volumes"
Jul 07 23:13:27.245460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:27.245429    2581 generic.go:356] "Generic (PLEG): container finished" podID="dc144964-8121-44bc-bbab-ddfa8682cbfa" containerID="3021334e1a5ffd9b7620af8068951380c0b03909c4e94b8a1e1a94ba597b6ebf" exitCode=0
Jul 07 23:13:27.245800 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:27.245500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j" event={"ID":"dc144964-8121-44bc-bbab-ddfa8682cbfa","Type":"ContainerDied","Data":"3021334e1a5ffd9b7620af8068951380c0b03909c4e94b8a1e1a94ba597b6ebf"}
Jul 07 23:13:27.245904 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:27.245872    2581 scope.go:117] "RemoveContainer" containerID="3021334e1a5ffd9b7620af8068951380c0b03909c4e94b8a1e1a94ba597b6ebf"
Jul 07 23:13:27.250168 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:27.247439    2581 generic.go:356] "Generic (PLEG): container finished" podID="973dd265-f78a-47c5-a6fb-ea9ba76e8124" containerID="76e2feb48353c27346e1799b5e92e6aa920566627450757a7e5577b776c940ce" exitCode=0
Jul 07 23:13:27.250168 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:27.247561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz" event={"ID":"973dd265-f78a-47c5-a6fb-ea9ba76e8124","Type":"ContainerDied","Data":"76e2feb48353c27346e1799b5e92e6aa920566627450757a7e5577b776c940ce"}
Jul 07 23:13:27.250168 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:27.249484    2581 scope.go:117] "RemoveContainer" containerID="76e2feb48353c27346e1799b5e92e6aa920566627450757a7e5577b776c940ce"
Jul 07 23:13:28.253470 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:28.253429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zmt2j" event={"ID":"dc144964-8121-44bc-bbab-ddfa8682cbfa","Type":"ContainerStarted","Data":"0d5df241c77b5d5edfca3973195e1b350a0699851ea19ed676dba1f63310d087"}
Jul 07 23:13:28.255235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:13:28.255210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9shz" event={"ID":"973dd265-f78a-47c5-a6fb-ea9ba76e8124","Type":"ContainerStarted","Data":"568327ef34e012b067e21781ddf090ff1d3bcb526630302b6de66f6d7579aa26"}
Jul 07 23:14:05.168010 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.167921    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"]
Jul 07 23:14:05.169077 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169053    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59c045d-40d0-423f-90e9-459b0c2ea094" containerName="console"
Jul 07 23:14:05.169226 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169213    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59c045d-40d0-423f-90e9-459b0c2ea094" containerName="console"
Jul 07 23:14:05.169326 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169315    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e27321e-5392-42d1-92db-134a78bdd828" containerName="registry"
Jul 07 23:14:05.169409 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169391    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e27321e-5392-42d1-92db-134a78bdd828" containerName="registry"
Jul 07 23:14:05.169532 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169416    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33ff662b-efaf-47ce-80d5-ad1d1f9f6118" containerName="console"
Jul 07 23:14:05.169532 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169425    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ff662b-efaf-47ce-80d5-ad1d1f9f6118" containerName="console"
Jul 07 23:14:05.169532 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169520    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59c045d-40d0-423f-90e9-459b0c2ea094" containerName="console"
Jul 07 23:14:05.169677 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169534    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e27321e-5392-42d1-92db-134a78bdd828" containerName="registry"
Jul 07 23:14:05.169677 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.169545    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="33ff662b-efaf-47ce-80d5-ad1d1f9f6118" containerName="console"
Jul 07 23:14:05.172970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.172950    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.176577 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.176555    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 23:14:05.176679 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.176636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 23:14:05.177219 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.177194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 23:14:05.177321 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.177264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 23:14:05.177321 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.177279    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 23:14:05.177677 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.177661    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jjwtq\""
Jul 07 23:14:05.182417 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.182395    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 23:14:05.187472 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.187447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"]
Jul 07 23:14:05.228876 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.228843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-serving-certs-ca-bundle\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.229040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.228884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-metrics-client-ca\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.229040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.228927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.229040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.228978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-federate-client-tls\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.229040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.229006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.229040 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.229025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-secret-telemeter-client\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.229240 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.229040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vgtk\" (UniqueName: \"kubernetes.io/projected/ba5b8869-74a8-4086-b0c3-637e9526f83b-kube-api-access-4vgtk\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.229240 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.229070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-telemeter-client-tls\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.329704 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.329666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.329704 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.329704    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-secret-telemeter-client\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.329937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.329724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vgtk\" (UniqueName: \"kubernetes.io/projected/ba5b8869-74a8-4086-b0c3-637e9526f83b-kube-api-access-4vgtk\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.329937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.329749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-telemeter-client-tls\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.329937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.329796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-serving-certs-ca-bundle\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.329937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.329820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-metrics-client-ca\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.330183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.329967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.330183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.330084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-federate-client-tls\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.330703 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.330676    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-metrics-client-ca\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.330839 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.330772    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-serving-certs-ca-bundle\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.330839 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.330810    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5b8869-74a8-4086-b0c3-637e9526f83b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.332361 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.332333    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.332530 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.332510    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-federate-client-tls\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.332685 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.332672    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-telemeter-client-tls\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.332722 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.332691    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba5b8869-74a8-4086-b0c3-637e9526f83b-secret-telemeter-client\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.338375 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.338353    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vgtk\" (UniqueName: \"kubernetes.io/projected/ba5b8869-74a8-4086-b0c3-637e9526f83b-kube-api-access-4vgtk\") pod \"telemeter-client-5cbc45fbb9-njtz4\" (UID: \"ba5b8869-74a8-4086-b0c3-637e9526f83b\") " pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.484002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.483922    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"
Jul 07 23:14:05.617933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:05.617787    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4"]
Jul 07 23:14:05.620755 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:14:05.620730    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5b8869_74a8_4086_b0c3_637e9526f83b.slice/crio-a1411986bcfffc016ce7a55df699b21704416bb38296e4c160cce8fa69e00800 WatchSource:0}: Error finding container a1411986bcfffc016ce7a55df699b21704416bb38296e4c160cce8fa69e00800: Status 404 returned error can't find the container with id a1411986bcfffc016ce7a55df699b21704416bb38296e4c160cce8fa69e00800
Jul 07 23:14:06.399515 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:06.399483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4" event={"ID":"ba5b8869-74a8-4086-b0c3-637e9526f83b","Type":"ContainerStarted","Data":"a1411986bcfffc016ce7a55df699b21704416bb38296e4c160cce8fa69e00800"}
Jul 07 23:14:08.409390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:08.409351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4" event={"ID":"ba5b8869-74a8-4086-b0c3-637e9526f83b","Type":"ContainerStarted","Data":"3e89e0f69da1e1541cb03f003efd8a1c30f54d9858fc4a54cd0f92433d59a8e9"}
Jul 07 23:14:09.415165 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:09.415125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4" event={"ID":"ba5b8869-74a8-4086-b0c3-637e9526f83b","Type":"ContainerStarted","Data":"ba11cf96beb7ea1a3c10981d7be9a3067173a7003211e93babc21428a600751c"}
Jul 07 23:14:09.415588 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:09.415180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4" event={"ID":"ba5b8869-74a8-4086-b0c3-637e9526f83b","Type":"ContainerStarted","Data":"170db2beebc08163a3f05f458e70f72dd1dbd689a3c4a502bd4ee044b06ca42d"}
Jul 07 23:14:09.438464 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:09.438401    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5cbc45fbb9-njtz4" podStartSLOduration=1.092038847 podStartE2EDuration="4.438384727s" totalImagesPullingTime="3.34634588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:09.437482798 +0000 UTC m=+180.657466886" watchObservedRunningTime="2026-07-07 23:14:09.438384727 +0000 UTC m=+180.658368817"
Jul 07 23:14:10.038818 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.038774    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66897dd7c8-whvs2"]
Jul 07 23:14:10.044000 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.043976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.054619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.054589    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66897dd7c8-whvs2"]
Jul 07 23:14:10.175858 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.175821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-oauth-serving-cert\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.176036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.175876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-trusted-ca-bundle\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.176036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.175924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-service-ca\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.176036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.175984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-oauth-config\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.176036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.176020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-serving-cert\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.176229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.176047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-console-config\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.176229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.176074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5z4\" (UniqueName: \"kubernetes.io/projected/56b80ae9-19c1-43bb-84fb-7999365fae10-kube-api-access-nr5z4\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.276757 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.276722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-serving-cert\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.277017 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.276996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-console-config\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.277158 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.277142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5z4\" (UniqueName: \"kubernetes.io/projected/56b80ae9-19c1-43bb-84fb-7999365fae10-kube-api-access-nr5z4\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.277292 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.277277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-oauth-serving-cert\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.277419 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.277405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-trusted-ca-bundle\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.277522 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.277506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-service-ca\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.277675 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.277659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-oauth-config\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.277962 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.277935    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-console-config\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.278606 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.278571    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-oauth-serving-cert\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.278951 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.278923    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-service-ca\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.279808 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.279780    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-trusted-ca-bundle\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.281163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.281141    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-oauth-config\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.281262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.281246    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-serving-cert\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.285998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.285969    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5z4\" (UniqueName: \"kubernetes.io/projected/56b80ae9-19c1-43bb-84fb-7999365fae10-kube-api-access-nr5z4\") pod \"console-66897dd7c8-whvs2\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") " pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.355658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.355619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:10.506795 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:10.506771    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66897dd7c8-whvs2"]
Jul 07 23:14:10.509269 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:14:10.509244    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b80ae9_19c1_43bb_84fb_7999365fae10.slice/crio-2f41dbb8e17409679d22f6b159a53d1c26fb5de793fcf2a34ee2f83de09d5ab3 WatchSource:0}: Error finding container 2f41dbb8e17409679d22f6b159a53d1c26fb5de793fcf2a34ee2f83de09d5ab3: Status 404 returned error can't find the container with id 2f41dbb8e17409679d22f6b159a53d1c26fb5de793fcf2a34ee2f83de09d5ab3
Jul 07 23:14:11.427908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:11.427871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66897dd7c8-whvs2" event={"ID":"56b80ae9-19c1-43bb-84fb-7999365fae10","Type":"ContainerStarted","Data":"f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124"}
Jul 07 23:14:11.428142 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:11.427929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66897dd7c8-whvs2" event={"ID":"56b80ae9-19c1-43bb-84fb-7999365fae10","Type":"ContainerStarted","Data":"2f41dbb8e17409679d22f6b159a53d1c26fb5de793fcf2a34ee2f83de09d5ab3"}
Jul 07 23:14:11.446291 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:11.446243    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66897dd7c8-whvs2" podStartSLOduration=1.446226089 podStartE2EDuration="1.446226089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:11.445672152 +0000 UTC m=+182.665656254" watchObservedRunningTime="2026-07-07 23:14:11.446226089 +0000 UTC m=+182.666210178"
Jul 07 23:14:18.025762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.025725    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66897dd7c8-whvs2"]
Jul 07 23:14:18.058389 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.058360    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c8694fc64-b6hpt"]
Jul 07 23:14:18.061782 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.061762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.076265 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.076244    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8694fc64-b6hpt"]
Jul 07 23:14:18.146574 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.146542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-config\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.146715 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.146585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-service-ca\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.146715 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.146601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-oauth-serving-cert\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.146715 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.146697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzmb\" (UniqueName: \"kubernetes.io/projected/91a1401d-dfe4-46ca-8762-e85e7d67997d-kube-api-access-qpzmb\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.146813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.146754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-oauth-config\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.146813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.146790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-serving-cert\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.146813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.146807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-trusted-ca-bundle\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.247540 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.247508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzmb\" (UniqueName: \"kubernetes.io/projected/91a1401d-dfe4-46ca-8762-e85e7d67997d-kube-api-access-qpzmb\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.247540 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.247545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-oauth-config\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.247724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.247569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-serving-cert\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.247724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.247586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-trusted-ca-bundle\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.247724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.247630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-config\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.247724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.247670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-service-ca\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.247724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.247698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-oauth-serving-cert\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.248530 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.248419    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-config\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.248530 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.248464    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-oauth-serving-cert\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.248530 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.248477    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-service-ca\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.248721 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.248698    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-trusted-ca-bundle\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.250133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.250090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-oauth-config\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.250227 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.250168    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-serving-cert\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.255634 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.255606    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzmb\" (UniqueName: \"kubernetes.io/projected/91a1401d-dfe4-46ca-8762-e85e7d67997d-kube-api-access-qpzmb\") pod \"console-6c8694fc64-b6hpt\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") " pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.371501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.371449    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:18.508939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:18.508905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8694fc64-b6hpt"]
Jul 07 23:14:18.511926 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:14:18.511902    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a1401d_dfe4_46ca_8762_e85e7d67997d.slice/crio-3e4fe2c0eeee1ad310a5288bfda23d1a4f31ca367551f5d398b78a2e45bfeb23 WatchSource:0}: Error finding container 3e4fe2c0eeee1ad310a5288bfda23d1a4f31ca367551f5d398b78a2e45bfeb23: Status 404 returned error can't find the container with id 3e4fe2c0eeee1ad310a5288bfda23d1a4f31ca367551f5d398b78a2e45bfeb23
Jul 07 23:14:19.459352 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:19.459313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8694fc64-b6hpt" event={"ID":"91a1401d-dfe4-46ca-8762-e85e7d67997d","Type":"ContainerStarted","Data":"610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143"}
Jul 07 23:14:19.459830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:19.459393    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8694fc64-b6hpt" event={"ID":"91a1401d-dfe4-46ca-8762-e85e7d67997d","Type":"ContainerStarted","Data":"3e4fe2c0eeee1ad310a5288bfda23d1a4f31ca367551f5d398b78a2e45bfeb23"}
Jul 07 23:14:19.476896 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:19.476844    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c8694fc64-b6hpt" podStartSLOduration=1.476829338 podStartE2EDuration="1.476829338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:19.475470988 +0000 UTC m=+190.695455076" watchObservedRunningTime="2026-07-07 23:14:19.476829338 +0000 UTC m=+190.696813426"
Jul 07 23:14:20.355764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:20.355715    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:28.371790 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:28.371749    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:28.372181 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:28.371823    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:28.376486 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:28.376462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:28.499879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:28.499852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:14:28.542548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:28.542506    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd74959c5-8jdpc"]
Jul 07 23:14:43.046381 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.046319    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66897dd7c8-whvs2" podUID="56b80ae9-19c1-43bb-84fb-7999365fae10" containerName="console" containerID="cri-o://f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124" gracePeriod=15
Jul 07 23:14:43.287471 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.287450    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:43.358554 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.358467    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-trusted-ca-bundle\") pod \"56b80ae9-19c1-43bb-84fb-7999365fae10\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") "
Jul 07 23:14:43.358554 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.358502    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-serving-cert\") pod \"56b80ae9-19c1-43bb-84fb-7999365fae10\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") "
Jul 07 23:14:43.358799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.358592    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-service-ca\") pod \"56b80ae9-19c1-43bb-84fb-7999365fae10\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") "
Jul 07 23:14:43.358799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.358614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-console-config\") pod \"56b80ae9-19c1-43bb-84fb-7999365fae10\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") "
Jul 07 23:14:43.358799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.358637    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr5z4\" (UniqueName: \"kubernetes.io/projected/56b80ae9-19c1-43bb-84fb-7999365fae10-kube-api-access-nr5z4\") pod \"56b80ae9-19c1-43bb-84fb-7999365fae10\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") "
Jul 07 23:14:43.358799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.358672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-oauth-serving-cert\") pod \"56b80ae9-19c1-43bb-84fb-7999365fae10\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") "
Jul 07 23:14:43.358799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.358712    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-oauth-config\") pod \"56b80ae9-19c1-43bb-84fb-7999365fae10\" (UID: \"56b80ae9-19c1-43bb-84fb-7999365fae10\") "
Jul 07 23:14:43.359057 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.359018    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "56b80ae9-19c1-43bb-84fb-7999365fae10" (UID: "56b80ae9-19c1-43bb-84fb-7999365fae10"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:43.359057 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.359026    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-service-ca" (OuterVolumeSpecName: "service-ca") pod "56b80ae9-19c1-43bb-84fb-7999365fae10" (UID: "56b80ae9-19c1-43bb-84fb-7999365fae10"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:43.359057 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.359032    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-console-config" (OuterVolumeSpecName: "console-config") pod "56b80ae9-19c1-43bb-84fb-7999365fae10" (UID: "56b80ae9-19c1-43bb-84fb-7999365fae10"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:43.359250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.359169    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "56b80ae9-19c1-43bb-84fb-7999365fae10" (UID: "56b80ae9-19c1-43bb-84fb-7999365fae10"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:43.360844 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.360818    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56b80ae9-19c1-43bb-84fb-7999365fae10-kube-api-access-nr5z4" (OuterVolumeSpecName: "kube-api-access-nr5z4") pod "56b80ae9-19c1-43bb-84fb-7999365fae10" (UID: "56b80ae9-19c1-43bb-84fb-7999365fae10"). InnerVolumeSpecName "kube-api-access-nr5z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:14:43.360938 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.360838    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "56b80ae9-19c1-43bb-84fb-7999365fae10" (UID: "56b80ae9-19c1-43bb-84fb-7999365fae10"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:14:43.360938 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.360895    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "56b80ae9-19c1-43bb-84fb-7999365fae10" (UID: "56b80ae9-19c1-43bb-84fb-7999365fae10"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:14:43.459520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.459490    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-trusted-ca-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:43.459520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.459514    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:43.459520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.459525    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:43.459740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.459533    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-console-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:43.459740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.459541    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr5z4\" (UniqueName: \"kubernetes.io/projected/56b80ae9-19c1-43bb-84fb-7999365fae10-kube-api-access-nr5z4\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:43.459740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.459549    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56b80ae9-19c1-43bb-84fb-7999365fae10-oauth-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:43.459740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.459559    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56b80ae9-19c1-43bb-84fb-7999365fae10-console-oauth-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:43.556155 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.556126    2581 generic.go:356] "Generic (PLEG): container finished" podID="56b80ae9-19c1-43bb-84fb-7999365fae10" containerID="f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124" exitCode=0
Jul 07 23:14:43.556323 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.556169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66897dd7c8-whvs2" event={"ID":"56b80ae9-19c1-43bb-84fb-7999365fae10","Type":"ContainerDied","Data":"f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124"}
Jul 07 23:14:43.556323 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.556173    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66897dd7c8-whvs2"
Jul 07 23:14:43.556323 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.556206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66897dd7c8-whvs2" event={"ID":"56b80ae9-19c1-43bb-84fb-7999365fae10","Type":"ContainerDied","Data":"2f41dbb8e17409679d22f6b159a53d1c26fb5de793fcf2a34ee2f83de09d5ab3"}
Jul 07 23:14:43.556323 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.556225    2581 scope.go:117] "RemoveContainer" containerID="f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124"
Jul 07 23:14:43.564565 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.564547    2581 scope.go:117] "RemoveContainer" containerID="f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124"
Jul 07 23:14:43.564803 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:14:43.564777    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124\": container with ID starting with f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124 not found: ID does not exist" containerID="f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124"
Jul 07 23:14:43.564856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.564804    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124"} err="failed to get container status \"f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124\": rpc error: code = NotFound desc = could not find container \"f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124\": container with ID starting with f54d5969d4e9697ecafec5c3c66c8a0d2a8ffd431ea4b703a9ba4d268b13f124 not found: ID does not exist"
Jul 07 23:14:43.575229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.575190    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66897dd7c8-whvs2"]
Jul 07 23:14:43.576688 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:43.576665    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66897dd7c8-whvs2"]
Jul 07 23:14:45.501543 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:45.501507    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56b80ae9-19c1-43bb-84fb-7999365fae10" path="/var/lib/kubelet/pods/56b80ae9-19c1-43bb-84fb-7999365fae10/volumes"
Jul 07 23:14:53.569591 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.569524    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bd74959c5-8jdpc" podUID="114da80c-5167-4fe2-a260-d73d8b28850e" containerName="console" containerID="cri-o://c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f" gracePeriod=15
Jul 07 23:14:53.817197 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.817173    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:14:53.947458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947378    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-service-ca\") pod \"114da80c-5167-4fe2-a260-d73d8b28850e\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") "
Jul 07 23:14:53.947458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947415    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-trusted-ca-bundle\") pod \"114da80c-5167-4fe2-a260-d73d8b28850e\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") "
Jul 07 23:14:53.947458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947439    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-oauth-serving-cert\") pod \"114da80c-5167-4fe2-a260-d73d8b28850e\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") "
Jul 07 23:14:53.947731 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947463    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-serving-cert\") pod \"114da80c-5167-4fe2-a260-d73d8b28850e\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") "
Jul 07 23:14:53.947731 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947481    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59bwz\" (UniqueName: \"kubernetes.io/projected/114da80c-5167-4fe2-a260-d73d8b28850e-kube-api-access-59bwz\") pod \"114da80c-5167-4fe2-a260-d73d8b28850e\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") "
Jul 07 23:14:53.947731 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947535    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-oauth-config\") pod \"114da80c-5167-4fe2-a260-d73d8b28850e\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") "
Jul 07 23:14:53.947731 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947558    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-console-config\") pod \"114da80c-5167-4fe2-a260-d73d8b28850e\" (UID: \"114da80c-5167-4fe2-a260-d73d8b28850e\") "
Jul 07 23:14:53.947946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947827    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "114da80c-5167-4fe2-a260-d73d8b28850e" (UID: "114da80c-5167-4fe2-a260-d73d8b28850e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:53.947946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.947885    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-service-ca" (OuterVolumeSpecName: "service-ca") pod "114da80c-5167-4fe2-a260-d73d8b28850e" (UID: "114da80c-5167-4fe2-a260-d73d8b28850e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:53.948055 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.948027    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "114da80c-5167-4fe2-a260-d73d8b28850e" (UID: "114da80c-5167-4fe2-a260-d73d8b28850e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:53.948119 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.948065    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-console-config" (OuterVolumeSpecName: "console-config") pod "114da80c-5167-4fe2-a260-d73d8b28850e" (UID: "114da80c-5167-4fe2-a260-d73d8b28850e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:14:53.949673 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.949647    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114da80c-5167-4fe2-a260-d73d8b28850e-kube-api-access-59bwz" (OuterVolumeSpecName: "kube-api-access-59bwz") pod "114da80c-5167-4fe2-a260-d73d8b28850e" (UID: "114da80c-5167-4fe2-a260-d73d8b28850e"). InnerVolumeSpecName "kube-api-access-59bwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:14:53.950140 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.950110    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "114da80c-5167-4fe2-a260-d73d8b28850e" (UID: "114da80c-5167-4fe2-a260-d73d8b28850e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:14:53.950140 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:53.950129    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "114da80c-5167-4fe2-a260-d73d8b28850e" (UID: "114da80c-5167-4fe2-a260-d73d8b28850e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:14:54.048414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.048377    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:54.048414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.048413    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-trusted-ca-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:54.048414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.048424    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-oauth-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:54.048623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.048433    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:54.048623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.048442    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59bwz\" (UniqueName: \"kubernetes.io/projected/114da80c-5167-4fe2-a260-d73d8b28850e-kube-api-access-59bwz\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:54.048623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.048451    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/114da80c-5167-4fe2-a260-d73d8b28850e-console-oauth-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:54.048623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.048458    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/114da80c-5167-4fe2-a260-d73d8b28850e-console-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:14:54.605298 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.605266    2581 generic.go:356] "Generic (PLEG): container finished" podID="114da80c-5167-4fe2-a260-d73d8b28850e" containerID="c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f" exitCode=0
Jul 07 23:14:54.605668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.605310    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74959c5-8jdpc"
Jul 07 23:14:54.605668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.605330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74959c5-8jdpc" event={"ID":"114da80c-5167-4fe2-a260-d73d8b28850e","Type":"ContainerDied","Data":"c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f"}
Jul 07 23:14:54.605668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.605366    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74959c5-8jdpc" event={"ID":"114da80c-5167-4fe2-a260-d73d8b28850e","Type":"ContainerDied","Data":"3b372e5760e9d93d477771e994e29fb2b5d5c459818d4c31eabf6dd11e6d6103"}
Jul 07 23:14:54.605668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.605386    2581 scope.go:117] "RemoveContainer" containerID="c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f"
Jul 07 23:14:54.614211 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.614192    2581 scope.go:117] "RemoveContainer" containerID="c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f"
Jul 07 23:14:54.614440 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:14:54.614423    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f\": container with ID starting with c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f not found: ID does not exist" containerID="c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f"
Jul 07 23:14:54.614490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.614449    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f"} err="failed to get container status \"c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f\": rpc error: code = NotFound desc = could not find container \"c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f\": container with ID starting with c9b12b9f2da63f21456b3e6478c3452211b2660db213360f2c8f58490d47801f not found: ID does not exist"
Jul 07 23:14:54.625534 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.625513    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd74959c5-8jdpc"]
Jul 07 23:14:54.629482 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:54.629463    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bd74959c5-8jdpc"]
Jul 07 23:14:55.501538 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:14:55.501497    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="114da80c-5167-4fe2-a260-d73d8b28850e" path="/var/lib/kubelet/pods/114da80c-5167-4fe2-a260-d73d8b28850e/volumes"
Jul 07 23:15:19.657332 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.657293    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"]
Jul 07 23:15:19.657706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.657599    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b80ae9-19c1-43bb-84fb-7999365fae10" containerName="console"
Jul 07 23:15:19.657706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.657610    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b80ae9-19c1-43bb-84fb-7999365fae10" containerName="console"
Jul 07 23:15:19.657706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.657626    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114da80c-5167-4fe2-a260-d73d8b28850e" containerName="console"
Jul 07 23:15:19.657706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.657631    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="114da80c-5167-4fe2-a260-d73d8b28850e" containerName="console"
Jul 07 23:15:19.657706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.657677    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="114da80c-5167-4fe2-a260-d73d8b28850e" containerName="console"
Jul 07 23:15:19.657706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.657686    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="56b80ae9-19c1-43bb-84fb-7999365fae10" containerName="console"
Jul 07 23:15:19.662150 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.662134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.664894 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.664871    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 23:15:19.665018 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.664950    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 23:15:19.665946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.665930    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c95gb\""
Jul 07 23:15:19.673748 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.673729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"]
Jul 07 23:15:19.760214 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.760180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.760412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.760242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.760412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.760280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vmv\" (UniqueName: \"kubernetes.io/projected/63d21d2f-cb6c-42cf-8d6d-3237abea4138-kube-api-access-49vmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.861276 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.861237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vmv\" (UniqueName: \"kubernetes.io/projected/63d21d2f-cb6c-42cf-8d6d-3237abea4138-kube-api-access-49vmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.861436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.861301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.861436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.861343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.861659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.861641    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.861717 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.861675    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.869922 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.869895    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vmv\" (UniqueName: \"kubernetes.io/projected/63d21d2f-cb6c-42cf-8d6d-3237abea4138-kube-api-access-49vmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:19.970582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:19.970493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:15:20.109948 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:20.109920    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"]
Jul 07 23:15:20.110702 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:15:20.110677    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d21d2f_cb6c_42cf_8d6d_3237abea4138.slice/crio-b2b45488d0447c505c85b50d2a4c0a7321ce45e67becc70725a0415b06ab25ba WatchSource:0}: Error finding container b2b45488d0447c505c85b50d2a4c0a7321ce45e67becc70725a0415b06ab25ba: Status 404 returned error can't find the container with id b2b45488d0447c505c85b50d2a4c0a7321ce45e67becc70725a0415b06ab25ba
Jul 07 23:15:20.705842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:20.705811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh" event={"ID":"63d21d2f-cb6c-42cf-8d6d-3237abea4138","Type":"ContainerStarted","Data":"b2b45488d0447c505c85b50d2a4c0a7321ce45e67becc70725a0415b06ab25ba"}
Jul 07 23:15:28.740352 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:28.740310    2581 generic.go:356] "Generic (PLEG): container finished" podID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerID="f2155438695a8c31cda5b11f7bfa7debd591a7b39f30a7c912fe27ec464895bc" exitCode=0
Jul 07 23:15:28.740745 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:15:28.740383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh" event={"ID":"63d21d2f-cb6c-42cf-8d6d-3237abea4138","Type":"ContainerDied","Data":"f2155438695a8c31cda5b11f7bfa7debd591a7b39f30a7c912fe27ec464895bc"}
Jul 07 23:16:01.871183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:01.871144    2581 generic.go:356] "Generic (PLEG): container finished" podID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerID="be1ad0a983b1a3cb7d62454953e6b28e9fa686a3af0b25f1641aa757d684ca9b" exitCode=0
Jul 07 23:16:01.871662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:01.871228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh" event={"ID":"63d21d2f-cb6c-42cf-8d6d-3237abea4138","Type":"ContainerDied","Data":"be1ad0a983b1a3cb7d62454953e6b28e9fa686a3af0b25f1641aa757d684ca9b"}
Jul 07 23:16:11.252650 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:11.252618    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:16:11.253954 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:11.252781    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:16:11.263200 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:11.263180    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 23:16:11.915662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:11.915618    2581 generic.go:356] "Generic (PLEG): container finished" podID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerID="cd0b718bd46b2acd26b590510fde70a8dfa19f4cde991593d0e01ff0e41b8632" exitCode=0
Jul 07 23:16:11.915858 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:11.915696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh" event={"ID":"63d21d2f-cb6c-42cf-8d6d-3237abea4138","Type":"ContainerDied","Data":"cd0b718bd46b2acd26b590510fde70a8dfa19f4cde991593d0e01ff0e41b8632"}
Jul 07 23:16:13.040925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.040904    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:16:13.208245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.208168    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-util\") pod \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") "
Jul 07 23:16:13.208245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.208207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49vmv\" (UniqueName: \"kubernetes.io/projected/63d21d2f-cb6c-42cf-8d6d-3237abea4138-kube-api-access-49vmv\") pod \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") "
Jul 07 23:16:13.208465 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.208306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-bundle\") pod \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\" (UID: \"63d21d2f-cb6c-42cf-8d6d-3237abea4138\") "
Jul 07 23:16:13.209088 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.209058    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-bundle" (OuterVolumeSpecName: "bundle") pod "63d21d2f-cb6c-42cf-8d6d-3237abea4138" (UID: "63d21d2f-cb6c-42cf-8d6d-3237abea4138"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:16:13.210486 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.210459    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d21d2f-cb6c-42cf-8d6d-3237abea4138-kube-api-access-49vmv" (OuterVolumeSpecName: "kube-api-access-49vmv") pod "63d21d2f-cb6c-42cf-8d6d-3237abea4138" (UID: "63d21d2f-cb6c-42cf-8d6d-3237abea4138"). InnerVolumeSpecName "kube-api-access-49vmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:16:13.212743 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.212719    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-util" (OuterVolumeSpecName: "util") pod "63d21d2f-cb6c-42cf-8d6d-3237abea4138" (UID: "63d21d2f-cb6c-42cf-8d6d-3237abea4138"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:16:13.308988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.308949    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-util\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:13.308988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.308979    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49vmv\" (UniqueName: \"kubernetes.io/projected/63d21d2f-cb6c-42cf-8d6d-3237abea4138-kube-api-access-49vmv\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:13.308988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.308993    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d21d2f-cb6c-42cf-8d6d-3237abea4138-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:13.926397 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.926373    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh"
Jul 07 23:16:13.926548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.926366    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405ngwh" event={"ID":"63d21d2f-cb6c-42cf-8d6d-3237abea4138","Type":"ContainerDied","Data":"b2b45488d0447c505c85b50d2a4c0a7321ce45e67becc70725a0415b06ab25ba"}
Jul 07 23:16:13.926548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:13.926495    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2b45488d0447c505c85b50d2a4c0a7321ce45e67becc70725a0415b06ab25ba"
Jul 07 23:16:22.522410 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522374    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"]
Jul 07 23:16:22.522898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522831    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerName="util"
Jul 07 23:16:22.522898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522849    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerName="util"
Jul 07 23:16:22.522898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522861    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerName="pull"
Jul 07 23:16:22.522898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522868    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerName="pull"
Jul 07 23:16:22.522898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522893    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerName="extract"
Jul 07 23:16:22.522898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522901    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerName="extract"
Jul 07 23:16:22.523230 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.522988    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d21d2f-cb6c-42cf-8d6d-3237abea4138" containerName="extract"
Jul 07 23:16:22.525218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.525193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.527644 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.527625    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 23:16:22.528643 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.528625    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c95gb\""
Jul 07 23:16:22.528750 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.528627    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 23:16:22.534529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.534498    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"]
Jul 07 23:16:22.690524 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.690480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.690714 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.690575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg5sq\" (UniqueName: \"kubernetes.io/projected/1ec672e2-72b9-421e-83ef-078f72ce0a89-kube-api-access-zg5sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.690714 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.690607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.791453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.791424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg5sq\" (UniqueName: \"kubernetes.io/projected/1ec672e2-72b9-421e-83ef-078f72ce0a89-kube-api-access-zg5sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.791600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.791463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.791600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.791504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.791830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.791808    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.791892 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.791840    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.805925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.805901    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg5sq\" (UniqueName: \"kubernetes.io/projected/1ec672e2-72b9-421e-83ef-078f72ce0a89-kube-api-access-zg5sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.834800 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.834763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:22.963731 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:22.963707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"]
Jul 07 23:16:22.965821 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:16:22.965798    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec672e2_72b9_421e_83ef_078f72ce0a89.slice/crio-24dea5a808dde45d9636b535b83397348059d5a3049bbd0f68787149075a97d1 WatchSource:0}: Error finding container 24dea5a808dde45d9636b535b83397348059d5a3049bbd0f68787149075a97d1: Status 404 returned error can't find the container with id 24dea5a808dde45d9636b535b83397348059d5a3049bbd0f68787149075a97d1
Jul 07 23:16:23.965715 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:23.965683    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerID="51b8108724e7770641ac65c3e5a28cb022660c7777b7110e3356cdf1df7fad55" exitCode=0
Jul 07 23:16:23.966081 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:23.965730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x" event={"ID":"1ec672e2-72b9-421e-83ef-078f72ce0a89","Type":"ContainerDied","Data":"51b8108724e7770641ac65c3e5a28cb022660c7777b7110e3356cdf1df7fad55"}
Jul 07 23:16:23.966081 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:23.965766    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x" event={"ID":"1ec672e2-72b9-421e-83ef-078f72ce0a89","Type":"ContainerStarted","Data":"24dea5a808dde45d9636b535b83397348059d5a3049bbd0f68787149075a97d1"}
Jul 07 23:16:23.966855 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:23.966835    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 23:16:24.986054 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:24.986021    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"]
Jul 07 23:16:24.988541 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:24.988514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:24.990910 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:24.990888    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 23:16:24.991834 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:24.991815    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gzshz\""
Jul 07 23:16:24.991834 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:24.991827    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 23:16:24.996441 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:24.996422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"]
Jul 07 23:16:25.111053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.111017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9mt8\" (UniqueName: \"kubernetes.io/projected/df60a45d-152e-43d1-baac-670d0d7c30d3-kube-api-access-f9mt8\") pod \"cert-manager-cainjector-559cdd8c87-hf5gz\" (UID: \"df60a45d-152e-43d1-baac-670d0d7c30d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:25.111233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.111067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df60a45d-152e-43d1-baac-670d0d7c30d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hf5gz\" (UID: \"df60a45d-152e-43d1-baac-670d0d7c30d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:25.212164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.212128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9mt8\" (UniqueName: \"kubernetes.io/projected/df60a45d-152e-43d1-baac-670d0d7c30d3-kube-api-access-f9mt8\") pod \"cert-manager-cainjector-559cdd8c87-hf5gz\" (UID: \"df60a45d-152e-43d1-baac-670d0d7c30d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:25.212342 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.212194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df60a45d-152e-43d1-baac-670d0d7c30d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hf5gz\" (UID: \"df60a45d-152e-43d1-baac-670d0d7c30d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:25.223421 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.223395    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9mt8\" (UniqueName: \"kubernetes.io/projected/df60a45d-152e-43d1-baac-670d0d7c30d3-kube-api-access-f9mt8\") pod \"cert-manager-cainjector-559cdd8c87-hf5gz\" (UID: \"df60a45d-152e-43d1-baac-670d0d7c30d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:25.224519 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.224501    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df60a45d-152e-43d1-baac-670d0d7c30d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hf5gz\" (UID: \"df60a45d-152e-43d1-baac-670d0d7c30d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:25.304582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.304548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"
Jul 07 23:16:25.446039 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.446007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz"]
Jul 07 23:16:25.448712 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:16:25.448688    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf60a45d_152e_43d1_baac_670d0d7c30d3.slice/crio-05b05f386610c63d47f3e88efcafcecc65d407e53b802fd9b1fdbca6581c0913 WatchSource:0}: Error finding container 05b05f386610c63d47f3e88efcafcecc65d407e53b802fd9b1fdbca6581c0913: Status 404 returned error can't find the container with id 05b05f386610c63d47f3e88efcafcecc65d407e53b802fd9b1fdbca6581c0913
Jul 07 23:16:25.976276 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:25.976240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz" event={"ID":"df60a45d-152e-43d1-baac-670d0d7c30d3","Type":"ContainerStarted","Data":"05b05f386610c63d47f3e88efcafcecc65d407e53b802fd9b1fdbca6581c0913"}
Jul 07 23:16:26.984189 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:26.984134    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerID="67f34c6bc66566b221bd05fc1d6d32384e5d9e554aa2b824f1fdd79b170990c8" exitCode=0
Jul 07 23:16:26.984657 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:26.984224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x" event={"ID":"1ec672e2-72b9-421e-83ef-078f72ce0a89","Type":"ContainerDied","Data":"67f34c6bc66566b221bd05fc1d6d32384e5d9e554aa2b824f1fdd79b170990c8"}
Jul 07 23:16:27.991278 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:27.991237    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerID="9d09cfb8bf70f18f1e52e9d176c6c1bd10385a42afaf1a28a6a1043108688c87" exitCode=0
Jul 07 23:16:27.991708 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:27.991325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x" event={"ID":"1ec672e2-72b9-421e-83ef-078f72ce0a89","Type":"ContainerDied","Data":"9d09cfb8bf70f18f1e52e9d176c6c1bd10385a42afaf1a28a6a1043108688c87"}
Jul 07 23:16:28.998814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:28.998717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz" event={"ID":"df60a45d-152e-43d1-baac-670d0d7c30d3","Type":"ContainerStarted","Data":"f5a9bb16d5e94eeb07b909ead8fdea1a080133ba835914656fcbc4f61c8c70bf"}
Jul 07 23:16:29.015281 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.015220    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hf5gz" podStartSLOduration=1.831665597 podStartE2EDuration="5.015202887s" totalImagesPullingTime="3.18353729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:16:29.013930564 +0000 UTC m=+320.233914654" watchObservedRunningTime="2026-07-07 23:16:29.015202887 +0000 UTC m=+320.235186975"
Jul 07 23:16:29.142968 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.142943    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:29.145236 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.145216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-util\") pod \"1ec672e2-72b9-421e-83ef-078f72ce0a89\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") "
Jul 07 23:16:29.145310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.145249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg5sq\" (UniqueName: \"kubernetes.io/projected/1ec672e2-72b9-421e-83ef-078f72ce0a89-kube-api-access-zg5sq\") pod \"1ec672e2-72b9-421e-83ef-078f72ce0a89\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") "
Jul 07 23:16:29.145310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.145306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-bundle\") pod \"1ec672e2-72b9-421e-83ef-078f72ce0a89\" (UID: \"1ec672e2-72b9-421e-83ef-078f72ce0a89\") "
Jul 07 23:16:29.145670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.145648    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-bundle" (OuterVolumeSpecName: "bundle") pod "1ec672e2-72b9-421e-83ef-078f72ce0a89" (UID: "1ec672e2-72b9-421e-83ef-078f72ce0a89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:16:29.147384 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.147360    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec672e2-72b9-421e-83ef-078f72ce0a89-kube-api-access-zg5sq" (OuterVolumeSpecName: "kube-api-access-zg5sq") pod "1ec672e2-72b9-421e-83ef-078f72ce0a89" (UID: "1ec672e2-72b9-421e-83ef-078f72ce0a89"). InnerVolumeSpecName "kube-api-access-zg5sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:16:29.149482 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.149462    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-util" (OuterVolumeSpecName: "util") pod "1ec672e2-72b9-421e-83ef-078f72ce0a89" (UID: "1ec672e2-72b9-421e-83ef-078f72ce0a89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:16:29.245920 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.245884    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:29.245920 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.245912    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec672e2-72b9-421e-83ef-078f72ce0a89-util\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:29.245920 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:29.245924    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg5sq\" (UniqueName: \"kubernetes.io/projected/1ec672e2-72b9-421e-83ef-078f72ce0a89-kube-api-access-zg5sq\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:30.004842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:30.004804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x" event={"ID":"1ec672e2-72b9-421e-83ef-078f72ce0a89","Type":"ContainerDied","Data":"24dea5a808dde45d9636b535b83397348059d5a3049bbd0f68787149075a97d1"}
Jul 07 23:16:30.004842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:30.004826    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsgb6x"
Jul 07 23:16:30.005296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:30.004856    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24dea5a808dde45d9636b535b83397348059d5a3049bbd0f68787149075a97d1"
Jul 07 23:16:34.847244 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847212    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9zdlg"]
Jul 07 23:16:34.847716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847519    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerName="util"
Jul 07 23:16:34.847716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847534    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerName="util"
Jul 07 23:16:34.847716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847572    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerName="extract"
Jul 07 23:16:34.847716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847582    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerName="extract"
Jul 07 23:16:34.847716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847595    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerName="pull"
Jul 07 23:16:34.847716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847603    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerName="pull"
Jul 07 23:16:34.847716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.847682    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ec672e2-72b9-421e-83ef-078f72ce0a89" containerName="extract"
Jul 07 23:16:34.875171 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.875142    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9zdlg"]
Jul 07 23:16:34.875304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.875161    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:34.877870 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.877850    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-d5d7f\""
Jul 07 23:16:34.886310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.886292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/011bc1a1-8e97-4493-aca2-47d9c8d31b45-bound-sa-token\") pod \"cert-manager-55b4d954d5-9zdlg\" (UID: \"011bc1a1-8e97-4493-aca2-47d9c8d31b45\") " pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:34.886399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.886345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sds7\" (UniqueName: \"kubernetes.io/projected/011bc1a1-8e97-4493-aca2-47d9c8d31b45-kube-api-access-6sds7\") pod \"cert-manager-55b4d954d5-9zdlg\" (UID: \"011bc1a1-8e97-4493-aca2-47d9c8d31b45\") " pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:34.987390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.987358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/011bc1a1-8e97-4493-aca2-47d9c8d31b45-bound-sa-token\") pod \"cert-manager-55b4d954d5-9zdlg\" (UID: \"011bc1a1-8e97-4493-aca2-47d9c8d31b45\") " pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:34.987562 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.987422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sds7\" (UniqueName: \"kubernetes.io/projected/011bc1a1-8e97-4493-aca2-47d9c8d31b45-kube-api-access-6sds7\") pod \"cert-manager-55b4d954d5-9zdlg\" (UID: \"011bc1a1-8e97-4493-aca2-47d9c8d31b45\") " pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:34.996703 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.996681    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/011bc1a1-8e97-4493-aca2-47d9c8d31b45-bound-sa-token\") pod \"cert-manager-55b4d954d5-9zdlg\" (UID: \"011bc1a1-8e97-4493-aca2-47d9c8d31b45\") " pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:34.996887 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:34.996867    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sds7\" (UniqueName: \"kubernetes.io/projected/011bc1a1-8e97-4493-aca2-47d9c8d31b45-kube-api-access-6sds7\") pod \"cert-manager-55b4d954d5-9zdlg\" (UID: \"011bc1a1-8e97-4493-aca2-47d9c8d31b45\") " pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:35.184207 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:35.184126    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9zdlg"
Jul 07 23:16:35.343585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:35.343559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9zdlg"]
Jul 07 23:16:35.346049 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:16:35.346018    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod011bc1a1_8e97_4493_aca2_47d9c8d31b45.slice/crio-163ed160dabd09749dfa361d10672093637b198ff969d9ac2b383b72acdd6b07 WatchSource:0}: Error finding container 163ed160dabd09749dfa361d10672093637b198ff969d9ac2b383b72acdd6b07: Status 404 returned error can't find the container with id 163ed160dabd09749dfa361d10672093637b198ff969d9ac2b383b72acdd6b07
Jul 07 23:16:36.034463 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:36.034427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9zdlg" event={"ID":"011bc1a1-8e97-4493-aca2-47d9c8d31b45","Type":"ContainerStarted","Data":"ef63636d88c5f16830f710a2603ad3b7d662a58f0902946762a8360404146aa9"}
Jul 07 23:16:36.034858 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:36.034471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9zdlg" event={"ID":"011bc1a1-8e97-4493-aca2-47d9c8d31b45","Type":"ContainerStarted","Data":"163ed160dabd09749dfa361d10672093637b198ff969d9ac2b383b72acdd6b07"}
Jul 07 23:16:36.049995 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:36.049943    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9zdlg" podStartSLOduration=2.049927508 podStartE2EDuration="2.049927508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:16:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:16:36.04926228 +0000 UTC m=+327.269246381" watchObservedRunningTime="2026-07-07 23:16:36.049927508 +0000 UTC m=+327.269911597"
Jul 07 23:16:48.271547 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.271461    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"]
Jul 07 23:16:48.274042 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.274025    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.276467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.276436    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 23:16:48.276467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.276455    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 23:16:48.276624 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.276543    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c95gb\""
Jul 07 23:16:48.286043 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.286021    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"]
Jul 07 23:16:48.299814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.299788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txkf4\" (UniqueName: \"kubernetes.io/projected/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-kube-api-access-txkf4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.299951 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.299824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.299951 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.299894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.401155 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.401122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.401294 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.401224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.401294 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.401280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txkf4\" (UniqueName: \"kubernetes.io/projected/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-kube-api-access-txkf4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.401493 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.401473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.401529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.401511    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.409291 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.409265    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txkf4\" (UniqueName: \"kubernetes.io/projected/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-kube-api-access-txkf4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.583236 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.583207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:48.715011 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:48.714932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"]
Jul 07 23:16:48.718364 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:16:48.718338    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e6ddee_4cb8_4fc2_9ff2_25bdd600beec.slice/crio-8a0756ec4ae85c303f698d9c2d56ba3dcad4a4350f00fb41e7d199a69cf579d3 WatchSource:0}: Error finding container 8a0756ec4ae85c303f698d9c2d56ba3dcad4a4350f00fb41e7d199a69cf579d3: Status 404 returned error can't find the container with id 8a0756ec4ae85c303f698d9c2d56ba3dcad4a4350f00fb41e7d199a69cf579d3
Jul 07 23:16:49.091733 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:49.091697    2581 generic.go:356] "Generic (PLEG): container finished" podID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerID="66094d12ece23a655dd9a903f6f22f0a4f36d23310a8057ad51268b275a7c547" exitCode=0
Jul 07 23:16:49.091897 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:49.091778    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2" event={"ID":"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec","Type":"ContainerDied","Data":"66094d12ece23a655dd9a903f6f22f0a4f36d23310a8057ad51268b275a7c547"}
Jul 07 23:16:49.091897 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:49.091823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2" event={"ID":"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec","Type":"ContainerStarted","Data":"8a0756ec4ae85c303f698d9c2d56ba3dcad4a4350f00fb41e7d199a69cf579d3"}
Jul 07 23:16:50.097968 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:50.097934    2581 generic.go:356] "Generic (PLEG): container finished" podID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerID="696c5ee7a60357eb188ae5dd884f4dc30dcb6f94d8294a1cfb2accb507ca510e" exitCode=0
Jul 07 23:16:50.098357 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:50.098020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2" event={"ID":"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec","Type":"ContainerDied","Data":"696c5ee7a60357eb188ae5dd884f4dc30dcb6f94d8294a1cfb2accb507ca510e"}
Jul 07 23:16:51.104458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:51.104423    2581 generic.go:356] "Generic (PLEG): container finished" podID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerID="0181ad8a956fa11e89ab99bed4a0b3e077541fa4e69796cb4d0b15437a79df95" exitCode=0
Jul 07 23:16:51.104853 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:51.104505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2" event={"ID":"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec","Type":"ContainerDied","Data":"0181ad8a956fa11e89ab99bed4a0b3e077541fa4e69796cb4d0b15437a79df95"}
Jul 07 23:16:52.231244 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.231221    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:52.332233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.332192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-util\") pod \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") "
Jul 07 23:16:52.332233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.332227    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-bundle\") pod \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") "
Jul 07 23:16:52.332423 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.332302    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txkf4\" (UniqueName: \"kubernetes.io/projected/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-kube-api-access-txkf4\") pod \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\" (UID: \"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec\") "
Jul 07 23:16:52.332992 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.332959    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-bundle" (OuterVolumeSpecName: "bundle") pod "71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" (UID: "71e6ddee-4cb8-4fc2-9ff2-25bdd600beec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:16:52.334387 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.334361    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-kube-api-access-txkf4" (OuterVolumeSpecName: "kube-api-access-txkf4") pod "71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" (UID: "71e6ddee-4cb8-4fc2-9ff2-25bdd600beec"). InnerVolumeSpecName "kube-api-access-txkf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:16:52.338224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.338202    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-util" (OuterVolumeSpecName: "util") pod "71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" (UID: "71e6ddee-4cb8-4fc2-9ff2-25bdd600beec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:16:52.433806 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.433726    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-util\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:52.433806 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.433753    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:52.433806 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:52.433764    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txkf4\" (UniqueName: \"kubernetes.io/projected/71e6ddee-4cb8-4fc2-9ff2-25bdd600beec-kube-api-access-txkf4\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:16:53.114888 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:53.114857    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2"
Jul 07 23:16:53.115061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:53.114888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j2j2" event={"ID":"71e6ddee-4cb8-4fc2-9ff2-25bdd600beec","Type":"ContainerDied","Data":"8a0756ec4ae85c303f698d9c2d56ba3dcad4a4350f00fb41e7d199a69cf579d3"}
Jul 07 23:16:53.115061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:16:53.114931    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a0756ec4ae85c303f698d9c2d56ba3dcad4a4350f00fb41e7d199a69cf579d3"
Jul 07 23:17:00.139167 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139133    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"]
Jul 07 23:17:00.139548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139463    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerName="util"
Jul 07 23:17:00.139548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139473    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerName="util"
Jul 07 23:17:00.139548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139481    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerName="extract"
Jul 07 23:17:00.139548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139486    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerName="extract"
Jul 07 23:17:00.139548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139501    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerName="pull"
Jul 07 23:17:00.139548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139506    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerName="pull"
Jul 07 23:17:00.139728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.139562    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e6ddee-4cb8-4fc2-9ff2-25bdd600beec" containerName="extract"
Jul 07 23:17:00.141655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.141640    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.145266 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.145245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 23:17:00.145516 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.145499    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5mqtv\""
Jul 07 23:17:00.145631 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.145616    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 23:17:00.146037 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.146022    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 23:17:00.153559 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.153541    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 23:17:00.179184 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.179159    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"]
Jul 07 23:17:00.201565 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.201541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.201699 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.201569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-manifests\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.201699 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.201594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7764\" (UniqueName: \"kubernetes.io/projected/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-kube-api-access-s7764\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.201699 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.201687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.201879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.201719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-tmp\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.302396 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.302359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7764\" (UniqueName: \"kubernetes.io/projected/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-kube-api-access-s7764\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.302601 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.302424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.302601 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.302446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-tmp\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.302601 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.302476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.302601 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.302496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-manifests\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.302911 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.302886    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-manifests\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.304858 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.304837    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-tmp\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.305025 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.305009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.305224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.305205    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.310362 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.310339    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7764\" (UniqueName: \"kubernetes.io/projected/79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1-kube-api-access-s7764\") pod \"opendatahub-operator-controller-manager-855c64c48d-tz6t7\" (UID: \"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.452440 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.452353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:00.587274 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:00.587250    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"]
Jul 07 23:17:00.589089 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:17:00.589062    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79aaa017_28c4_4eb1_b40d_ccb8bc1cc6d1.slice/crio-47970821a38e95e054c53d9a50daf83634869f4e9700c39ad97214d81d343c10 WatchSource:0}: Error finding container 47970821a38e95e054c53d9a50daf83634869f4e9700c39ad97214d81d343c10: Status 404 returned error can't find the container with id 47970821a38e95e054c53d9a50daf83634869f4e9700c39ad97214d81d343c10
Jul 07 23:17:01.158659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:01.158581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7" event={"ID":"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1","Type":"ContainerStarted","Data":"47970821a38e95e054c53d9a50daf83634869f4e9700c39ad97214d81d343c10"}
Jul 07 23:17:04.177170 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:04.177134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7" event={"ID":"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1","Type":"ContainerStarted","Data":"aa86918c1dca88363feed73d12e92f0c6db7023b4220e82e14d8bc2106ff02c5"}
Jul 07 23:17:05.183487 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:05.183455    2581 generic.go:356] "Generic (PLEG): container finished" podID="79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1" containerID="aa86918c1dca88363feed73d12e92f0c6db7023b4220e82e14d8bc2106ff02c5" exitCode=0
Jul 07 23:17:05.183898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:05.183543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7" event={"ID":"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1","Type":"ContainerDied","Data":"aa86918c1dca88363feed73d12e92f0c6db7023b4220e82e14d8bc2106ff02c5"}
Jul 07 23:17:06.190370 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:06.190333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7" event={"ID":"79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1","Type":"ContainerStarted","Data":"e82b2863994d47b756b597136da1c6bd084fe2fb4e85a2b32605f4ac5caaecee"}
Jul 07 23:17:06.190876 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:06.190454    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:06.214728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:06.214678    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7" podStartSLOduration=1.7003358450000001 podStartE2EDuration="6.214660156s" totalImagesPullingTime="3.48993512s" totalInitContainerRuntime="1.024389191s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:06.213626266 +0000 UTC m=+357.433610365" watchObservedRunningTime="2026-07-07 23:17:06.214660156 +0000 UTC m=+357.434644245"
Jul 07 23:17:17.197501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:17.197472    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-tz6t7"
Jul 07 23:17:35.369878 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.369841    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"]
Jul 07 23:17:35.372550 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.372532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.386725 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.386697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eff03bd-cd00-4df7-a921-8924a31dfbc7-tls-certs\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.386842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.386752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eff03bd-cd00-4df7-a921-8924a31dfbc7-tmp\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.386842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.386818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfwk\" (UniqueName: \"kubernetes.io/projected/6eff03bd-cd00-4df7-a921-8924a31dfbc7-kube-api-access-5tfwk\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.393530 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.393501    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 23:17:35.393659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.393526    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t7z4l\""
Jul 07 23:17:35.393659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.393591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 23:17:35.395811 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.395790    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"]
Jul 07 23:17:35.487890 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.487860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfwk\" (UniqueName: \"kubernetes.io/projected/6eff03bd-cd00-4df7-a921-8924a31dfbc7-kube-api-access-5tfwk\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.488064 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.487906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eff03bd-cd00-4df7-a921-8924a31dfbc7-tls-certs\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.488145 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.488123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eff03bd-cd00-4df7-a921-8924a31dfbc7-tmp\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.490317 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.490294    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eff03bd-cd00-4df7-a921-8924a31dfbc7-tmp\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.490430 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.490334    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eff03bd-cd00-4df7-a921-8924a31dfbc7-tls-certs\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.507889 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.507861    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfwk\" (UniqueName: \"kubernetes.io/projected/6eff03bd-cd00-4df7-a921-8924a31dfbc7-kube-api-access-5tfwk\") pod \"kube-auth-proxy-67dd9c547-s8h6n\" (UID: \"6eff03bd-cd00-4df7-a921-8924a31dfbc7\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.681903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.681812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"
Jul 07 23:17:35.826801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:35.826726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n"]
Jul 07 23:17:35.829131 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:17:35.829082    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eff03bd_cd00_4df7_a921_8924a31dfbc7.slice/crio-3741d44e0346f1f2bafad897cde5e9830e4d8e881c71285d25bd356c52db4cb5 WatchSource:0}: Error finding container 3741d44e0346f1f2bafad897cde5e9830e4d8e881c71285d25bd356c52db4cb5: Status 404 returned error can't find the container with id 3741d44e0346f1f2bafad897cde5e9830e4d8e881c71285d25bd356c52db4cb5
Jul 07 23:17:36.331730 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.331698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n" event={"ID":"6eff03bd-cd00-4df7-a921-8924a31dfbc7","Type":"ContainerStarted","Data":"3741d44e0346f1f2bafad897cde5e9830e4d8e881c71285d25bd356c52db4cb5"}
Jul 07 23:17:36.413081 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.413048    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jjbh7"]
Jul 07 23:17:36.416093 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.416076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:36.418631 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.418607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 23:17:36.418735 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.418647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nlk2f\""
Jul 07 23:17:36.426783 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.426760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jjbh7"]
Jul 07 23:17:36.495378 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.495348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw278\" (UniqueName: \"kubernetes.io/projected/a984dd74-baef-4991-94c0-d2da18c61fff-kube-api-access-mw278\") pod \"model-serving-api-54d89bd5fc-jjbh7\" (UID: \"a984dd74-baef-4991-94c0-d2da18c61fff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:36.495544 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.495483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a984dd74-baef-4991-94c0-d2da18c61fff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jjbh7\" (UID: \"a984dd74-baef-4991-94c0-d2da18c61fff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:36.595987 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.595909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw278\" (UniqueName: \"kubernetes.io/projected/a984dd74-baef-4991-94c0-d2da18c61fff-kube-api-access-mw278\") pod \"model-serving-api-54d89bd5fc-jjbh7\" (UID: \"a984dd74-baef-4991-94c0-d2da18c61fff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:36.596163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.595999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a984dd74-baef-4991-94c0-d2da18c61fff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jjbh7\" (UID: \"a984dd74-baef-4991-94c0-d2da18c61fff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:36.596220 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:17:36.596182    2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 07 23:17:36.596265 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:17:36.596254    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a984dd74-baef-4991-94c0-d2da18c61fff-tls-certs podName:a984dd74-baef-4991-94c0-d2da18c61fff nodeName:}" failed. No retries permitted until 2026-07-07 23:17:37.096233096 +0000 UTC m=+388.316217180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a984dd74-baef-4991-94c0-d2da18c61fff-tls-certs") pod "model-serving-api-54d89bd5fc-jjbh7" (UID: "a984dd74-baef-4991-94c0-d2da18c61fff") : secret "model-serving-api-tls" not found
Jul 07 23:17:36.610239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.610210    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw278\" (UniqueName: \"kubernetes.io/projected/a984dd74-baef-4991-94c0-d2da18c61fff-kube-api-access-mw278\") pod \"model-serving-api-54d89bd5fc-jjbh7\" (UID: \"a984dd74-baef-4991-94c0-d2da18c61fff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:36.712887 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.712845    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"]
Jul 07 23:17:36.715913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.715887    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.719268 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.719245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 23:17:36.719547 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.719528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 23:17:36.720286 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.720228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 23:17:36.720517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.720497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 23:17:36.720875 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.720852    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gzjtk\""
Jul 07 23:17:36.733670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.733610    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"]
Jul 07 23:17:36.798008 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.797973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-istio-token\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.798175 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.798014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.798175 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.798037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-cacerts\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.798269 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.798205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.798269 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.798245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.798338 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.798271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b525a876-58e7-4b96-a4ff-bc211220e217-local-certs\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.798338 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.798286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9jxn\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-kube-api-access-j9jxn\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.899808 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.899722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.899808 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.899779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.900029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.899813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b525a876-58e7-4b96-a4ff-bc211220e217-local-certs\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.900029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.899837    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9jxn\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-kube-api-access-j9jxn\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.900029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.899881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-istio-token\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.900029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.899942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.900029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.899977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-cacerts\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.900879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.900836    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.902724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.902702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.902804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.902768    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b525a876-58e7-4b96-a4ff-bc211220e217-local-certs\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.902998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.902978    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.903037 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.903009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-cacerts\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.908894 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.908866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-istio-token\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:36.909036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:36.909013    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9jxn\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-kube-api-access-j9jxn\") pod \"istiod-openshift-gateway-7574459656-vpztk\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:37.030726 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:37.030688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:37.101619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:37.101566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a984dd74-baef-4991-94c0-d2da18c61fff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jjbh7\" (UID: \"a984dd74-baef-4991-94c0-d2da18c61fff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:37.104599 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:37.104570    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a984dd74-baef-4991-94c0-d2da18c61fff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jjbh7\" (UID: \"a984dd74-baef-4991-94c0-d2da18c61fff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:37.199800 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:37.199714    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"]
Jul 07 23:17:37.203356 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:17:37.203330    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb525a876_58e7_4b96_a4ff_bc211220e217.slice/crio-e90c30b30f5e4730578d225323a91843095c8edec6ae07fcdff180161134bbd4 WatchSource:0}: Error finding container e90c30b30f5e4730578d225323a91843095c8edec6ae07fcdff180161134bbd4: Status 404 returned error can't find the container with id e90c30b30f5e4730578d225323a91843095c8edec6ae07fcdff180161134bbd4
Jul 07 23:17:37.328089 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:37.328046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:37.339262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:37.339020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk" event={"ID":"b525a876-58e7-4b96-a4ff-bc211220e217","Type":"ContainerStarted","Data":"e90c30b30f5e4730578d225323a91843095c8edec6ae07fcdff180161134bbd4"}
Jul 07 23:17:37.485527 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:37.485442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jjbh7"]
Jul 07 23:17:37.488822 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:17:37.488788    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda984dd74_baef_4991_94c0_d2da18c61fff.slice/crio-952b85fb9cf79e98fcebb7cea561ee4bbf03cceadf8e10336de211a1bb5ff043 WatchSource:0}: Error finding container 952b85fb9cf79e98fcebb7cea561ee4bbf03cceadf8e10336de211a1bb5ff043: Status 404 returned error can't find the container with id 952b85fb9cf79e98fcebb7cea561ee4bbf03cceadf8e10336de211a1bb5ff043
Jul 07 23:17:38.348662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:38.348621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7" event={"ID":"a984dd74-baef-4991-94c0-d2da18c61fff","Type":"ContainerStarted","Data":"952b85fb9cf79e98fcebb7cea561ee4bbf03cceadf8e10336de211a1bb5ff043"}
Jul 07 23:17:39.356850 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:39.356816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n" event={"ID":"6eff03bd-cd00-4df7-a921-8924a31dfbc7","Type":"ContainerStarted","Data":"bc615c3bcd21a9f8293231f73dd13688a1942ffee4aa53a40dfd99cbd9ecf3f8"}
Jul 07 23:17:39.378047 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:39.377984    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67dd9c547-s8h6n" podStartSLOduration=0.997939956 podStartE2EDuration="4.377962701s" totalImagesPullingTime="3.380022745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:39.375525846 +0000 UTC m=+390.595509937" watchObservedRunningTime="2026-07-07 23:17:39.377962701 +0000 UTC m=+390.597946792"
Jul 07 23:17:40.620931 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:40.620898    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:17:40.621359 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:40.620959    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:17:41.369919 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.369660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk" event={"ID":"b525a876-58e7-4b96-a4ff-bc211220e217","Type":"ContainerStarted","Data":"4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93"}
Jul 07 23:17:41.370122 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.370002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:41.371602 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.371544    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vpztk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 23:17:41.371767 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.371734    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk" podUID="b525a876-58e7-4b96-a4ff-bc211220e217" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 23:17:41.372174 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.372069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7" event={"ID":"a984dd74-baef-4991-94c0-d2da18c61fff","Type":"ContainerStarted","Data":"0ccf65852f65035cd2855c7ca6c16c302c8c35e1d3c9b0625d3a66c0842b78d1"}
Jul 07 23:17:41.372174 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.372163    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:17:41.399033 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.398947    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk" podStartSLOduration=1.983524095 podStartE2EDuration="5.398922963s" totalImagesPullingTime="3.415398868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:41.395363478 +0000 UTC m=+392.615347564" watchObservedRunningTime="2026-07-07 23:17:41.398922963 +0000 UTC m=+392.618907033"
Jul 07 23:17:41.419142 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:41.419067    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7" podStartSLOduration=2.295101989 podStartE2EDuration="5.419046194s" totalImagesPullingTime="3.123944205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:41.416008118 +0000 UTC m=+392.635992208" watchObservedRunningTime="2026-07-07 23:17:41.419046194 +0000 UTC m=+392.639030284"
Jul 07 23:17:42.377615 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:42.377590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:46.503082 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.503043    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"]
Jul 07 23:17:46.506948 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.506921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.509453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.509432    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 23:17:46.509593 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.509565    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7szc7\""
Jul 07 23:17:46.512504 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.512483    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"]
Jul 07 23:17:46.515925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.515905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.516278 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.516255    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"]
Jul 07 23:17:46.518499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.518464    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 23:17:46.518628 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.518531    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qpdnl\""
Jul 07 23:17:46.532262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.532237    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"]
Jul 07 23:17:46.590247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.590217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmzs\" (UniqueName: \"kubernetes.io/projected/2720e0d2-299b-4688-8e53-7742c860d5af-kube-api-access-dqmzs\") pod \"llmisvc-controller-manager-777c6bd7d5-6rdz2\" (UID: \"2720e0d2-299b-4688-8e53-7742c860d5af\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.590382 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.590259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/386c9243-11c7-4f03-b19d-2acda4db5784-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9nfc\" (UID: \"386c9243-11c7-4f03-b19d-2acda4db5784\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.590382 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.590307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2720e0d2-299b-4688-8e53-7742c860d5af-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6rdz2\" (UID: \"2720e0d2-299b-4688-8e53-7742c860d5af\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.590382 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.590326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rb5v\" (UniqueName: \"kubernetes.io/projected/386c9243-11c7-4f03-b19d-2acda4db5784-kube-api-access-4rb5v\") pod \"kserve-controller-manager-d6f4b65b8-g9nfc\" (UID: \"386c9243-11c7-4f03-b19d-2acda4db5784\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.695446 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.695407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/386c9243-11c7-4f03-b19d-2acda4db5784-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9nfc\" (UID: \"386c9243-11c7-4f03-b19d-2acda4db5784\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.695765 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.695741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2720e0d2-299b-4688-8e53-7742c860d5af-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6rdz2\" (UID: \"2720e0d2-299b-4688-8e53-7742c860d5af\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.695924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.695906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rb5v\" (UniqueName: \"kubernetes.io/projected/386c9243-11c7-4f03-b19d-2acda4db5784-kube-api-access-4rb5v\") pod \"kserve-controller-manager-d6f4b65b8-g9nfc\" (UID: \"386c9243-11c7-4f03-b19d-2acda4db5784\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.696059 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.696044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmzs\" (UniqueName: \"kubernetes.io/projected/2720e0d2-299b-4688-8e53-7742c860d5af-kube-api-access-dqmzs\") pod \"llmisvc-controller-manager-777c6bd7d5-6rdz2\" (UID: \"2720e0d2-299b-4688-8e53-7742c860d5af\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.698854 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.698828    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2720e0d2-299b-4688-8e53-7742c860d5af-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6rdz2\" (UID: \"2720e0d2-299b-4688-8e53-7742c860d5af\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.699072 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.699038    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/386c9243-11c7-4f03-b19d-2acda4db5784-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9nfc\" (UID: \"386c9243-11c7-4f03-b19d-2acda4db5784\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.715573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.715552    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rb5v\" (UniqueName: \"kubernetes.io/projected/386c9243-11c7-4f03-b19d-2acda4db5784-kube-api-access-4rb5v\") pod \"kserve-controller-manager-d6f4b65b8-g9nfc\" (UID: \"386c9243-11c7-4f03-b19d-2acda4db5784\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.719046 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.719022    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmzs\" (UniqueName: \"kubernetes.io/projected/2720e0d2-299b-4688-8e53-7742c860d5af-kube-api-access-dqmzs\") pod \"llmisvc-controller-manager-777c6bd7d5-6rdz2\" (UID: \"2720e0d2-299b-4688-8e53-7742c860d5af\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.818541 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.818515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:46.828690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.828671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:46.967952 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.967928    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"]
Jul 07 23:17:46.971325 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:17:46.971300    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386c9243_11c7_4f03_b19d_2acda4db5784.slice/crio-66459dddfd4f616261a5ecb472fbcc1bac3d1d2ad07a3c4b88db688e1bc14c8d WatchSource:0}: Error finding container 66459dddfd4f616261a5ecb472fbcc1bac3d1d2ad07a3c4b88db688e1bc14c8d: Status 404 returned error can't find the container with id 66459dddfd4f616261a5ecb472fbcc1bac3d1d2ad07a3c4b88db688e1bc14c8d
Jul 07 23:17:46.997513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:46.997480    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"]
Jul 07 23:17:46.998990 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:17:46.998968    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2720e0d2_299b_4688_8e53_7742c860d5af.slice/crio-f5fde0d4dfe4cbcab7f2cd6b524699f3ca2a56768a9591c49be1dd01200f1e90 WatchSource:0}: Error finding container f5fde0d4dfe4cbcab7f2cd6b524699f3ca2a56768a9591c49be1dd01200f1e90: Status 404 returned error can't find the container with id f5fde0d4dfe4cbcab7f2cd6b524699f3ca2a56768a9591c49be1dd01200f1e90
Jul 07 23:17:47.403657 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:47.403622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc" event={"ID":"386c9243-11c7-4f03-b19d-2acda4db5784","Type":"ContainerStarted","Data":"66459dddfd4f616261a5ecb472fbcc1bac3d1d2ad07a3c4b88db688e1bc14c8d"}
Jul 07 23:17:47.405338 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:47.405309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2" event={"ID":"2720e0d2-299b-4688-8e53-7742c860d5af","Type":"ContainerStarted","Data":"f5fde0d4dfe4cbcab7f2cd6b524699f3ca2a56768a9591c49be1dd01200f1e90"}
Jul 07 23:17:49.360735 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:49.360700    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"]
Jul 07 23:17:49.361273 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:49.360950    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk" podUID="b525a876-58e7-4b96-a4ff-bc211220e217" containerName="discovery" containerID="cri-o://4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93" gracePeriod=30
Jul 07 23:17:50.199581 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.199557    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:50.327262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-kubeconfig\") pod \"b525a876-58e7-4b96-a4ff-bc211220e217\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") "
Jul 07 23:17:50.327401 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327288    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-ca-configmap\") pod \"b525a876-58e7-4b96-a4ff-bc211220e217\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") "
Jul 07 23:17:50.327473 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b525a876-58e7-4b96-a4ff-bc211220e217-local-certs\") pod \"b525a876-58e7-4b96-a4ff-bc211220e217\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") "
Jul 07 23:17:50.327473 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-istio-token\") pod \"b525a876-58e7-4b96-a4ff-bc211220e217\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") "
Jul 07 23:17:50.327572 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327502    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-cacerts\") pod \"b525a876-58e7-4b96-a4ff-bc211220e217\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") "
Jul 07 23:17:50.327683 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327573    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9jxn\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-kube-api-access-j9jxn\") pod \"b525a876-58e7-4b96-a4ff-bc211220e217\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") "
Jul 07 23:17:50.327683 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327605    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-dns-cert\") pod \"b525a876-58e7-4b96-a4ff-bc211220e217\" (UID: \"b525a876-58e7-4b96-a4ff-bc211220e217\") "
Jul 07 23:17:50.327683 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327640    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b525a876-58e7-4b96-a4ff-bc211220e217" (UID: "b525a876-58e7-4b96-a4ff-bc211220e217"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:17:50.327938 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.327886    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-ca-configmap\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:17:50.329914 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.329887    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b525a876-58e7-4b96-a4ff-bc211220e217-local-certs" (OuterVolumeSpecName: "local-certs") pod "b525a876-58e7-4b96-a4ff-bc211220e217" (UID: "b525a876-58e7-4b96-a4ff-bc211220e217"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:17:50.330151 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.330070    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b525a876-58e7-4b96-a4ff-bc211220e217" (UID: "b525a876-58e7-4b96-a4ff-bc211220e217"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:17:50.330151 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.330093    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-cacerts" (OuterVolumeSpecName: "cacerts") pod "b525a876-58e7-4b96-a4ff-bc211220e217" (UID: "b525a876-58e7-4b96-a4ff-bc211220e217"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:17:50.330151 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.330087    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-istio-token" (OuterVolumeSpecName: "istio-token") pod "b525a876-58e7-4b96-a4ff-bc211220e217" (UID: "b525a876-58e7-4b96-a4ff-bc211220e217"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:17:50.330348 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.330169    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-kube-api-access-j9jxn" (OuterVolumeSpecName: "kube-api-access-j9jxn") pod "b525a876-58e7-4b96-a4ff-bc211220e217" (UID: "b525a876-58e7-4b96-a4ff-bc211220e217"). InnerVolumeSpecName "kube-api-access-j9jxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:17:50.330348 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.330328    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b525a876-58e7-4b96-a4ff-bc211220e217" (UID: "b525a876-58e7-4b96-a4ff-bc211220e217"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:17:50.422621 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.422586    2581 generic.go:356] "Generic (PLEG): container finished" podID="b525a876-58e7-4b96-a4ff-bc211220e217" containerID="4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93" exitCode=0
Jul 07 23:17:50.423147 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.422636    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"
Jul 07 23:17:50.423147 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.422676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk" event={"ID":"b525a876-58e7-4b96-a4ff-bc211220e217","Type":"ContainerDied","Data":"4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93"}
Jul 07 23:17:50.423147 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.422735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpztk" event={"ID":"b525a876-58e7-4b96-a4ff-bc211220e217","Type":"ContainerDied","Data":"e90c30b30f5e4730578d225323a91843095c8edec6ae07fcdff180161134bbd4"}
Jul 07 23:17:50.423147 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.422760    2581 scope.go:117] "RemoveContainer" containerID="4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93"
Jul 07 23:17:50.424474 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.424447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc" event={"ID":"386c9243-11c7-4f03-b19d-2acda4db5784","Type":"ContainerStarted","Data":"8c85f713f76cbbf8a0336f9d5b2cf8c514dfd2cb7761d83d5f8643eb3f8f0a72"}
Jul 07 23:17:50.424612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.424503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:17:50.426246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.426186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2" event={"ID":"2720e0d2-299b-4688-8e53-7742c860d5af","Type":"ContainerStarted","Data":"0077fed7351d9314e89ec2519b0d77ec65e78a4fc46c0304881adb09788c6e43"}
Jul 07 23:17:50.426246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.426235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:17:50.428491 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.428433    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-kubeconfig\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:17:50.428491 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.428458    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b525a876-58e7-4b96-a4ff-bc211220e217-local-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:17:50.428491 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.428472    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:17:50.428491 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.428483    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-cacerts\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:17:50.428772 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.428494    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9jxn\" (UniqueName: \"kubernetes.io/projected/b525a876-58e7-4b96-a4ff-bc211220e217-kube-api-access-j9jxn\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:17:50.428772 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.428506    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b525a876-58e7-4b96-a4ff-bc211220e217-istio-csr-dns-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:17:50.432258 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.432241    2581 scope.go:117] "RemoveContainer" containerID="4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93"
Jul 07 23:17:50.432510 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:17:50.432494    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93\": container with ID starting with 4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93 not found: ID does not exist" containerID="4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93"
Jul 07 23:17:50.432557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.432518    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93"} err="failed to get container status \"4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93\": rpc error: code = NotFound desc = could not find container \"4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93\": container with ID starting with 4ac21e2b5a78c9707634f2ed15053fb7f691228953e94a1d0d241f35229e7f93 not found: ID does not exist"
Jul 07 23:17:50.442018 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.441980    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2" podStartSLOduration=1.227585618 podStartE2EDuration="4.441967137s" totalImagesPullingTime="3.214381519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:50.440802704 +0000 UTC m=+401.660786792" watchObservedRunningTime="2026-07-07 23:17:50.441967137 +0000 UTC m=+401.661951264"
Jul 07 23:17:50.457656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.457609    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc" podStartSLOduration=1.219897396 podStartE2EDuration="4.457594532s" totalImagesPullingTime="3.237697136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:50.457312261 +0000 UTC m=+401.677296360" watchObservedRunningTime="2026-07-07 23:17:50.457594532 +0000 UTC m=+401.677578621"
Jul 07 23:17:50.478124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.478084    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"]
Jul 07 23:17:50.482562 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:50.482541    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpztk"]
Jul 07 23:17:51.502185 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:51.502146    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b525a876-58e7-4b96-a4ff-bc211220e217" path="/var/lib/kubelet/pods/b525a876-58e7-4b96-a4ff-bc211220e217/volumes"
Jul 07 23:17:52.381059 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:17:52.381026    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jjbh7"
Jul 07 23:18:21.434673 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:21.434639    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6rdz2"
Jul 07 23:18:21.437519 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:21.437497    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9nfc"
Jul 07 23:18:36.495569 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.495492    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfznz"]
Jul 07 23:18:36.495912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.495842    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b525a876-58e7-4b96-a4ff-bc211220e217" containerName="discovery"
Jul 07 23:18:36.495912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.495853    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b525a876-58e7-4b96-a4ff-bc211220e217" containerName="discovery"
Jul 07 23:18:36.495912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.495911    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b525a876-58e7-4b96-a4ff-bc211220e217" containerName="discovery"
Jul 07 23:18:36.498998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.498973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dfznz"
Jul 07 23:18:36.502021 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.501853    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 23:18:36.502021 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.501853    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 23:18:36.503078 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.503053    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xdmh8\""
Jul 07 23:18:36.510133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.510086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfznz"]
Jul 07 23:18:36.513637 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.513618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8667s\" (UniqueName: \"kubernetes.io/projected/1ae0b7b2-966c-490c-9e74-234944e3613c-kube-api-access-8667s\") pod \"kuadrant-operator-catalog-dfznz\" (UID: \"1ae0b7b2-966c-490c-9e74-234944e3613c\") " pod="kuadrant-system/kuadrant-operator-catalog-dfznz"
Jul 07 23:18:36.614180 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.614150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8667s\" (UniqueName: \"kubernetes.io/projected/1ae0b7b2-966c-490c-9e74-234944e3613c-kube-api-access-8667s\") pod \"kuadrant-operator-catalog-dfznz\" (UID: \"1ae0b7b2-966c-490c-9e74-234944e3613c\") " pod="kuadrant-system/kuadrant-operator-catalog-dfznz"
Jul 07 23:18:36.622718 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.622684    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8667s\" (UniqueName: \"kubernetes.io/projected/1ae0b7b2-966c-490c-9e74-234944e3613c-kube-api-access-8667s\") pod \"kuadrant-operator-catalog-dfznz\" (UID: \"1ae0b7b2-966c-490c-9e74-234944e3613c\") " pod="kuadrant-system/kuadrant-operator-catalog-dfznz"
Jul 07 23:18:36.810242 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.810207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dfznz"
Jul 07 23:18:36.859737 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.859704    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfznz"]
Jul 07 23:18:36.942003 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:36.941973    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfznz"]
Jul 07 23:18:36.944463 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:18:36.944438    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae0b7b2_966c_490c_9e74_234944e3613c.slice/crio-afc12d63cb3e20d18f457a3f6da869320a1e4c1b13c589137bf8e77b31c15f66 WatchSource:0}: Error finding container afc12d63cb3e20d18f457a3f6da869320a1e4c1b13c589137bf8e77b31c15f66: Status 404 returned error can't find the container with id afc12d63cb3e20d18f457a3f6da869320a1e4c1b13c589137bf8e77b31c15f66
Jul 07 23:18:37.068624 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.068547    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6qzj7"]
Jul 07 23:18:37.073005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.072988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:37.079417 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.079393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6qzj7"]
Jul 07 23:18:37.118356 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.118326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qv8k\" (UniqueName: \"kubernetes.io/projected/cd1ad209-a90e-4456-a02c-ef3531a1ce7b-kube-api-access-5qv8k\") pod \"kuadrant-operator-catalog-6qzj7\" (UID: \"cd1ad209-a90e-4456-a02c-ef3531a1ce7b\") " pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:37.218822 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.218795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qv8k\" (UniqueName: \"kubernetes.io/projected/cd1ad209-a90e-4456-a02c-ef3531a1ce7b-kube-api-access-5qv8k\") pod \"kuadrant-operator-catalog-6qzj7\" (UID: \"cd1ad209-a90e-4456-a02c-ef3531a1ce7b\") " pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:37.227936 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.227912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qv8k\" (UniqueName: \"kubernetes.io/projected/cd1ad209-a90e-4456-a02c-ef3531a1ce7b-kube-api-access-5qv8k\") pod \"kuadrant-operator-catalog-6qzj7\" (UID: \"cd1ad209-a90e-4456-a02c-ef3531a1ce7b\") " pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:37.383724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.383638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:37.529795 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.529771    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6qzj7"]
Jul 07 23:18:37.531611 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:18:37.531583    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1ad209_a90e_4456_a02c_ef3531a1ce7b.slice/crio-c7d8b130b1babef1a11b800feb846e6cf7699656a87e80bfffd7e862a86e83b7 WatchSource:0}: Error finding container c7d8b130b1babef1a11b800feb846e6cf7699656a87e80bfffd7e862a86e83b7: Status 404 returned error can't find the container with id c7d8b130b1babef1a11b800feb846e6cf7699656a87e80bfffd7e862a86e83b7
Jul 07 23:18:37.661397 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.661327    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dfznz" event={"ID":"1ae0b7b2-966c-490c-9e74-234944e3613c","Type":"ContainerStarted","Data":"afc12d63cb3e20d18f457a3f6da869320a1e4c1b13c589137bf8e77b31c15f66"}
Jul 07 23:18:37.662552 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:37.662518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7" event={"ID":"cd1ad209-a90e-4456-a02c-ef3531a1ce7b","Type":"ContainerStarted","Data":"c7d8b130b1babef1a11b800feb846e6cf7699656a87e80bfffd7e862a86e83b7"}
Jul 07 23:18:39.675878 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.675843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7" event={"ID":"cd1ad209-a90e-4456-a02c-ef3531a1ce7b","Type":"ContainerStarted","Data":"67aef854ef3fb57ba9d9aae25142a6e892d6a9810defcf6eb146e91e9c6ddf17"}
Jul 07 23:18:39.677353 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.677326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dfznz" event={"ID":"1ae0b7b2-966c-490c-9e74-234944e3613c","Type":"ContainerStarted","Data":"b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92"}
Jul 07 23:18:39.677466 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.677367    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dfznz" podUID="1ae0b7b2-966c-490c-9e74-234944e3613c" containerName="registry-server" containerID="cri-o://b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92" gracePeriod=2
Jul 07 23:18:39.691704 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.691574    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7" podStartSLOduration=1.111600935 podStartE2EDuration="2.691560292s" totalImagesPullingTime="1.579959357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:18:39.690246618 +0000 UTC m=+450.910230720" watchObservedRunningTime="2026-07-07 23:18:39.691560292 +0000 UTC m=+450.911544380"
Jul 07 23:18:39.706836 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.706790    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dfznz" podStartSLOduration=1.5423662 podStartE2EDuration="3.706775954s" totalImagesPullingTime="2.164409754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:18:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:18:39.704804708 +0000 UTC m=+450.924788798" watchObservedRunningTime="2026-07-07 23:18:39.706775954 +0000 UTC m=+450.926760043"
Jul 07 23:18:39.919203 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.919179    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dfznz"
Jul 07 23:18:39.945903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.945843    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8667s\" (UniqueName: \"kubernetes.io/projected/1ae0b7b2-966c-490c-9e74-234944e3613c-kube-api-access-8667s\") pod \"1ae0b7b2-966c-490c-9e74-234944e3613c\" (UID: \"1ae0b7b2-966c-490c-9e74-234944e3613c\") "
Jul 07 23:18:39.947889 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:39.947864    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae0b7b2-966c-490c-9e74-234944e3613c-kube-api-access-8667s" (OuterVolumeSpecName: "kube-api-access-8667s") pod "1ae0b7b2-966c-490c-9e74-234944e3613c" (UID: "1ae0b7b2-966c-490c-9e74-234944e3613c"). InnerVolumeSpecName "kube-api-access-8667s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:18:40.047286 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.047256    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8667s\" (UniqueName: \"kubernetes.io/projected/1ae0b7b2-966c-490c-9e74-234944e3613c-kube-api-access-8667s\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:40.682870 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.682836    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ae0b7b2-966c-490c-9e74-234944e3613c" containerID="b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92" exitCode=0
Jul 07 23:18:40.683398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.682879    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dfznz"
Jul 07 23:18:40.683398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.682910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dfznz" event={"ID":"1ae0b7b2-966c-490c-9e74-234944e3613c","Type":"ContainerDied","Data":"b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92"}
Jul 07 23:18:40.683398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.682946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dfznz" event={"ID":"1ae0b7b2-966c-490c-9e74-234944e3613c","Type":"ContainerDied","Data":"afc12d63cb3e20d18f457a3f6da869320a1e4c1b13c589137bf8e77b31c15f66"}
Jul 07 23:18:40.683398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.682965    2581 scope.go:117] "RemoveContainer" containerID="b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92"
Jul 07 23:18:40.692276 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.692261    2581 scope.go:117] "RemoveContainer" containerID="b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92"
Jul 07 23:18:40.692505 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:18:40.692490    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92\": container with ID starting with b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92 not found: ID does not exist" containerID="b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92"
Jul 07 23:18:40.692542 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.692513    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92"} err="failed to get container status \"b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92\": rpc error: code = NotFound desc = could not find container \"b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92\": container with ID starting with b6fda165f4c805934d64272afbea253662a0b857163f435052e434c0c4da1a92 not found: ID does not exist"
Jul 07 23:18:40.702492 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.702469    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfznz"]
Jul 07 23:18:40.705917 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:40.705899    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dfznz"]
Jul 07 23:18:41.502396 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:41.502359    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ae0b7b2-966c-490c-9e74-234944e3613c" path="/var/lib/kubelet/pods/1ae0b7b2-966c-490c-9e74-234944e3613c/volumes"
Jul 07 23:18:47.384662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:47.384630    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:47.385089 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:47.384682    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:47.407118 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:47.407072    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:47.739499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:47.739431    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6qzj7"
Jul 07 23:18:51.901676 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.901638    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"]
Jul 07 23:18:51.902206 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.902188    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae0b7b2-966c-490c-9e74-234944e3613c" containerName="registry-server"
Jul 07 23:18:51.902296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.902208    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae0b7b2-966c-490c-9e74-234944e3613c" containerName="registry-server"
Jul 07 23:18:51.902355 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.902302    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae0b7b2-966c-490c-9e74-234944e3613c" containerName="registry-server"
Jul 07 23:18:51.906949 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.906928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:51.909506 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.909488    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d6jqq\""
Jul 07 23:18:51.913720 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.913700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"]
Jul 07 23:18:51.939079 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.939054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:51.939213 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.939195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj8dn\" (UniqueName: \"kubernetes.io/projected/d75dc54e-4c86-4c1b-ab46-7f805de3706c-kube-api-access-dj8dn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:51.939256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:51.939235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.040397 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.040359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj8dn\" (UniqueName: \"kubernetes.io/projected/d75dc54e-4c86-4c1b-ab46-7f805de3706c-kube-api-access-dj8dn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.040582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.040409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.040582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.040453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.040804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.040781    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.040874 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.040820    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.048809 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.048780    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj8dn\" (UniqueName: \"kubernetes.io/projected/d75dc54e-4c86-4c1b-ab46-7f805de3706c-kube-api-access-dj8dn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.217011 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.216935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:52.351462 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.351439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"]
Jul 07 23:18:52.354004 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:18:52.353975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75dc54e_4c86_4c1b_ab46_7f805de3706c.slice/crio-d599e2ee4c12e62a9dc947174e8349a5edd762bbc8797ab7fc5bc537b6552e50 WatchSource:0}: Error finding container d599e2ee4c12e62a9dc947174e8349a5edd762bbc8797ab7fc5bc537b6552e50: Status 404 returned error can't find the container with id d599e2ee4c12e62a9dc947174e8349a5edd762bbc8797ab7fc5bc537b6552e50
Jul 07 23:18:52.502777 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.502702    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"]
Jul 07 23:18:52.506369 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.506354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.513925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.513898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"]
Jul 07 23:18:52.545225 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.545196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.545381 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.545324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2htpt\" (UniqueName: \"kubernetes.io/projected/063d391d-607d-44a4-a558-b4403c5260e0-kube-api-access-2htpt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.545426 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.545377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.646290 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.646258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2htpt\" (UniqueName: \"kubernetes.io/projected/063d391d-607d-44a4-a558-b4403c5260e0-kube-api-access-2htpt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.646460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.646302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.646460 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.646330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.646747 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.646727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.646785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.646739    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.655371 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.655343    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2htpt\" (UniqueName: \"kubernetes.io/projected/063d391d-607d-44a4-a558-b4403c5260e0-kube-api-access-2htpt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.741901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.741870    2581 generic.go:356] "Generic (PLEG): container finished" podID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerID="7e8ea18c71f99431bb8b03a039f414b9708e87093304a20f019af4a056646313" exitCode=0
Jul 07 23:18:52.742034 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.741907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq" event={"ID":"d75dc54e-4c86-4c1b-ab46-7f805de3706c","Type":"ContainerDied","Data":"7e8ea18c71f99431bb8b03a039f414b9708e87093304a20f019af4a056646313"}
Jul 07 23:18:52.742034 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.741956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq" event={"ID":"d75dc54e-4c86-4c1b-ab46-7f805de3706c","Type":"ContainerStarted","Data":"d599e2ee4c12e62a9dc947174e8349a5edd762bbc8797ab7fc5bc537b6552e50"}
Jul 07 23:18:52.816673 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.816645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:52.901948 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.901921    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"]
Jul 07 23:18:52.907167 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.907147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:52.913701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.913624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"]
Jul 07 23:18:52.948666 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.948633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:52.948808 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.948690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:52.948808 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.948733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4btx6\" (UniqueName: \"kubernetes.io/projected/76a17912-0203-432c-ba5e-fbc7e08f54e7-kube-api-access-4btx6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:52.956821 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:52.956798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"]
Jul 07 23:18:52.959026 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:18:52.959002    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063d391d_607d_44a4_a558_b4403c5260e0.slice/crio-2ca058e104ee78338bebb914e118ea8295ed7c9c0cde4bd0088cbde79dcb47de WatchSource:0}: Error finding container 2ca058e104ee78338bebb914e118ea8295ed7c9c0cde4bd0088cbde79dcb47de: Status 404 returned error can't find the container with id 2ca058e104ee78338bebb914e118ea8295ed7c9c0cde4bd0088cbde79dcb47de
Jul 07 23:18:53.049452 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.049427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:53.049581 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.049480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btx6\" (UniqueName: \"kubernetes.io/projected/76a17912-0203-432c-ba5e-fbc7e08f54e7-kube-api-access-4btx6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:53.049581 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.049522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:53.049779 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.049759    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:53.049857 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.049839    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:53.059626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.059602    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4btx6\" (UniqueName: \"kubernetes.io/projected/76a17912-0203-432c-ba5e-fbc7e08f54e7-kube-api-access-4btx6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:53.219645 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.219610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:53.309893 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.309849    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"]
Jul 07 23:18:53.314217 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.314195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.321867 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.321796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"]
Jul 07 23:18:53.352005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.351970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.352005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.352012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.352277 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.352132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcmnc\" (UniqueName: \"kubernetes.io/projected/10a78d13-ae61-48dc-aff0-8fe2c79b2807-kube-api-access-xcmnc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.362571 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.362548    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"]
Jul 07 23:18:53.370840 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:18:53.370807    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a17912_0203_432c_ba5e_fbc7e08f54e7.slice/crio-121f6d059b3f5f83dcdae8c5ce866613c81affd61f0d3ff3c12ffca3f380831b WatchSource:0}: Error finding container 121f6d059b3f5f83dcdae8c5ce866613c81affd61f0d3ff3c12ffca3f380831b: Status 404 returned error can't find the container with id 121f6d059b3f5f83dcdae8c5ce866613c81affd61f0d3ff3c12ffca3f380831b
Jul 07 23:18:53.453278 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.453250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcmnc\" (UniqueName: \"kubernetes.io/projected/10a78d13-ae61-48dc-aff0-8fe2c79b2807-kube-api-access-xcmnc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.453434 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.453304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.453434 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.453333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.453612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.453594    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.453673 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.453637    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.461734 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.461699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcmnc\" (UniqueName: \"kubernetes.io/projected/10a78d13-ae61-48dc-aff0-8fe2c79b2807-kube-api-access-xcmnc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.626634 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.626555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:53.748880 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.748850    2581 generic.go:356] "Generic (PLEG): container finished" podID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerID="e58543c4fe4a4f7664a57c09874f202a0a46f961cb2676763dd315e500b42ab3" exitCode=0
Jul 07 23:18:53.749038 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.748921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg" event={"ID":"76a17912-0203-432c-ba5e-fbc7e08f54e7","Type":"ContainerDied","Data":"e58543c4fe4a4f7664a57c09874f202a0a46f961cb2676763dd315e500b42ab3"}
Jul 07 23:18:53.749038 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.748965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg" event={"ID":"76a17912-0203-432c-ba5e-fbc7e08f54e7","Type":"ContainerStarted","Data":"121f6d059b3f5f83dcdae8c5ce866613c81affd61f0d3ff3c12ffca3f380831b"}
Jul 07 23:18:53.750988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.750962    2581 generic.go:356] "Generic (PLEG): container finished" podID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerID="dc8ab2c4162fd8b4c0dc8a95b48a3cb21f80f8daa4df90f08ed339821be2d642" exitCode=0
Jul 07 23:18:53.751136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.751034    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq" event={"ID":"d75dc54e-4c86-4c1b-ab46-7f805de3706c","Type":"ContainerDied","Data":"dc8ab2c4162fd8b4c0dc8a95b48a3cb21f80f8daa4df90f08ed339821be2d642"}
Jul 07 23:18:53.752646 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.752626    2581 generic.go:356] "Generic (PLEG): container finished" podID="063d391d-607d-44a4-a558-b4403c5260e0" containerID="9ec6b120dfc356202ba36f8b8aa0b7a3e2c07bdd585367257e71ccfc45ffe926" exitCode=0
Jul 07 23:18:53.752746 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.752665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r" event={"ID":"063d391d-607d-44a4-a558-b4403c5260e0","Type":"ContainerDied","Data":"9ec6b120dfc356202ba36f8b8aa0b7a3e2c07bdd585367257e71ccfc45ffe926"}
Jul 07 23:18:53.752746 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.752701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r" event={"ID":"063d391d-607d-44a4-a558-b4403c5260e0","Type":"ContainerStarted","Data":"2ca058e104ee78338bebb914e118ea8295ed7c9c0cde4bd0088cbde79dcb47de"}
Jul 07 23:18:53.757301 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:53.757288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"]
Jul 07 23:18:53.758860 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:18:53.758834    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a78d13_ae61_48dc_aff0_8fe2c79b2807.slice/crio-d3ef47dd1292acaef6bcfa9ee5b564d1b106f700589c2548fa04493fbb051ab2 WatchSource:0}: Error finding container d3ef47dd1292acaef6bcfa9ee5b564d1b106f700589c2548fa04493fbb051ab2: Status 404 returned error can't find the container with id d3ef47dd1292acaef6bcfa9ee5b564d1b106f700589c2548fa04493fbb051ab2
Jul 07 23:18:54.760079 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.760048    2581 generic.go:356] "Generic (PLEG): container finished" podID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerID="bf8ae1383ce34653ea6e673e7f70ad9edc60c443abe956ef33f89d81d86c9a47" exitCode=0
Jul 07 23:18:54.760437 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.760139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq" event={"ID":"d75dc54e-4c86-4c1b-ab46-7f805de3706c","Type":"ContainerDied","Data":"bf8ae1383ce34653ea6e673e7f70ad9edc60c443abe956ef33f89d81d86c9a47"}
Jul 07 23:18:54.761763 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.761740    2581 generic.go:356] "Generic (PLEG): container finished" podID="063d391d-607d-44a4-a558-b4403c5260e0" containerID="867e41edc795865a877b4f55821ad32d03c62e1faa726dea4c23ee089043ab91" exitCode=0
Jul 07 23:18:54.761865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.761821    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r" event={"ID":"063d391d-607d-44a4-a558-b4403c5260e0","Type":"ContainerDied","Data":"867e41edc795865a877b4f55821ad32d03c62e1faa726dea4c23ee089043ab91"}
Jul 07 23:18:54.763366 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.763271    2581 generic.go:356] "Generic (PLEG): container finished" podID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerID="b3a73ce3b49209c3358c7960dcb68f747d33532e2f2a97533b606d57cf1b49c4" exitCode=0
Jul 07 23:18:54.763366 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.763298    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb" event={"ID":"10a78d13-ae61-48dc-aff0-8fe2c79b2807","Type":"ContainerDied","Data":"b3a73ce3b49209c3358c7960dcb68f747d33532e2f2a97533b606d57cf1b49c4"}
Jul 07 23:18:54.763366 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.763353    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb" event={"ID":"10a78d13-ae61-48dc-aff0-8fe2c79b2807","Type":"ContainerStarted","Data":"d3ef47dd1292acaef6bcfa9ee5b564d1b106f700589c2548fa04493fbb051ab2"}
Jul 07 23:18:54.765148 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.765128    2581 generic.go:356] "Generic (PLEG): container finished" podID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerID="c0d2476553f3d869d44156bbc8bc4c7e8ec38d81b4bd9d73c7d214490a2f1dcb" exitCode=0
Jul 07 23:18:54.765243 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:54.765178    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg" event={"ID":"76a17912-0203-432c-ba5e-fbc7e08f54e7","Type":"ContainerDied","Data":"c0d2476553f3d869d44156bbc8bc4c7e8ec38d81b4bd9d73c7d214490a2f1dcb"}
Jul 07 23:18:55.771958 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.771925    2581 generic.go:356] "Generic (PLEG): container finished" podID="063d391d-607d-44a4-a558-b4403c5260e0" containerID="15c1af9091b747edbfe66f0a60db77e1a27dd53870a978aa004cd1d15602df68" exitCode=0
Jul 07 23:18:55.772351 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.772005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r" event={"ID":"063d391d-607d-44a4-a558-b4403c5260e0","Type":"ContainerDied","Data":"15c1af9091b747edbfe66f0a60db77e1a27dd53870a978aa004cd1d15602df68"}
Jul 07 23:18:55.773799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.773781    2581 generic.go:356] "Generic (PLEG): container finished" podID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerID="796f80377fb65d70a0998b92c31494cebbf4c5d7a21a160be5886f7edac32dbc" exitCode=0
Jul 07 23:18:55.773895 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.773871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb" event={"ID":"10a78d13-ae61-48dc-aff0-8fe2c79b2807","Type":"ContainerDied","Data":"796f80377fb65d70a0998b92c31494cebbf4c5d7a21a160be5886f7edac32dbc"}
Jul 07 23:18:55.776139 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.776091    2581 generic.go:356] "Generic (PLEG): container finished" podID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerID="4c70af2149f5df73b9ab1f3b777915b71471b8470411fe1be500a1be0e1f588b" exitCode=0
Jul 07 23:18:55.776228 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.776124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg" event={"ID":"76a17912-0203-432c-ba5e-fbc7e08f54e7","Type":"ContainerDied","Data":"4c70af2149f5df73b9ab1f3b777915b71471b8470411fe1be500a1be0e1f588b"}
Jul 07 23:18:55.920311 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.920288    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:55.983192 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.983162    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-bundle\") pod \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") "
Jul 07 23:18:55.983347 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.983198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj8dn\" (UniqueName: \"kubernetes.io/projected/d75dc54e-4c86-4c1b-ab46-7f805de3706c-kube-api-access-dj8dn\") pod \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") "
Jul 07 23:18:55.983347 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.983266    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-util\") pod \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\" (UID: \"d75dc54e-4c86-4c1b-ab46-7f805de3706c\") "
Jul 07 23:18:55.983582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.983561    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-bundle" (OuterVolumeSpecName: "bundle") pod "d75dc54e-4c86-4c1b-ab46-7f805de3706c" (UID: "d75dc54e-4c86-4c1b-ab46-7f805de3706c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:55.985198 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.985171    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d75dc54e-4c86-4c1b-ab46-7f805de3706c-kube-api-access-dj8dn" (OuterVolumeSpecName: "kube-api-access-dj8dn") pod "d75dc54e-4c86-4c1b-ab46-7f805de3706c" (UID: "d75dc54e-4c86-4c1b-ab46-7f805de3706c"). InnerVolumeSpecName "kube-api-access-dj8dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:18:55.988312 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:55.988292    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-util" (OuterVolumeSpecName: "util") pod "d75dc54e-4c86-4c1b-ab46-7f805de3706c" (UID: "d75dc54e-4c86-4c1b-ab46-7f805de3706c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:56.084856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.084793    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:56.084856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.084819    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj8dn\" (UniqueName: \"kubernetes.io/projected/d75dc54e-4c86-4c1b-ab46-7f805de3706c-kube-api-access-dj8dn\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:56.084856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.084828    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75dc54e-4c86-4c1b-ab46-7f805de3706c-util\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:56.783432 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.783402    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq"
Jul 07 23:18:56.783432 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.783413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq" event={"ID":"d75dc54e-4c86-4c1b-ab46-7f805de3706c","Type":"ContainerDied","Data":"d599e2ee4c12e62a9dc947174e8349a5edd762bbc8797ab7fc5bc537b6552e50"}
Jul 07 23:18:56.783883 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.783456    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d599e2ee4c12e62a9dc947174e8349a5edd762bbc8797ab7fc5bc537b6552e50"
Jul 07 23:18:56.785444 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.785419    2581 generic.go:356] "Generic (PLEG): container finished" podID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerID="b1e1d0013b77ed5fa25c57fac66fb6cf62d330310123a681e07c20362bc0c26e" exitCode=0
Jul 07 23:18:56.785557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.785489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb" event={"ID":"10a78d13-ae61-48dc-aff0-8fe2c79b2807","Type":"ContainerDied","Data":"b1e1d0013b77ed5fa25c57fac66fb6cf62d330310123a681e07c20362bc0c26e"}
Jul 07 23:18:56.943553 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.943532    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:56.945590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.945574    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:56.993915 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.993880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-bundle\") pod \"063d391d-607d-44a4-a558-b4403c5260e0\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") "
Jul 07 23:18:56.994121 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.993946    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-util\") pod \"063d391d-607d-44a4-a558-b4403c5260e0\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") "
Jul 07 23:18:56.994121 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.993980    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2htpt\" (UniqueName: \"kubernetes.io/projected/063d391d-607d-44a4-a558-b4403c5260e0-kube-api-access-2htpt\") pod \"063d391d-607d-44a4-a558-b4403c5260e0\" (UID: \"063d391d-607d-44a4-a558-b4403c5260e0\") "
Jul 07 23:18:56.994555 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.994512    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-bundle" (OuterVolumeSpecName: "bundle") pod "063d391d-607d-44a4-a558-b4403c5260e0" (UID: "063d391d-607d-44a4-a558-b4403c5260e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:56.996269 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.996245    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063d391d-607d-44a4-a558-b4403c5260e0-kube-api-access-2htpt" (OuterVolumeSpecName: "kube-api-access-2htpt") pod "063d391d-607d-44a4-a558-b4403c5260e0" (UID: "063d391d-607d-44a4-a558-b4403c5260e0"). InnerVolumeSpecName "kube-api-access-2htpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:18:56.998789 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:56.998767    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-util" (OuterVolumeSpecName: "util") pod "063d391d-607d-44a4-a558-b4403c5260e0" (UID: "063d391d-607d-44a4-a558-b4403c5260e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:57.094419 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.094388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-bundle\") pod \"76a17912-0203-432c-ba5e-fbc7e08f54e7\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") "
Jul 07 23:18:57.094561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.094475    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-util\") pod \"76a17912-0203-432c-ba5e-fbc7e08f54e7\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") "
Jul 07 23:18:57.094561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.094493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4btx6\" (UniqueName: \"kubernetes.io/projected/76a17912-0203-432c-ba5e-fbc7e08f54e7-kube-api-access-4btx6\") pod \"76a17912-0203-432c-ba5e-fbc7e08f54e7\" (UID: \"76a17912-0203-432c-ba5e-fbc7e08f54e7\") "
Jul 07 23:18:57.094722 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.094705    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:57.094759 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.094728    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/063d391d-607d-44a4-a558-b4403c5260e0-util\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:57.094759 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.094742    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2htpt\" (UniqueName: \"kubernetes.io/projected/063d391d-607d-44a4-a558-b4403c5260e0-kube-api-access-2htpt\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:57.094845 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.094819    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-bundle" (OuterVolumeSpecName: "bundle") pod "76a17912-0203-432c-ba5e-fbc7e08f54e7" (UID: "76a17912-0203-432c-ba5e-fbc7e08f54e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:57.096787 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.096742    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a17912-0203-432c-ba5e-fbc7e08f54e7-kube-api-access-4btx6" (OuterVolumeSpecName: "kube-api-access-4btx6") pod "76a17912-0203-432c-ba5e-fbc7e08f54e7" (UID: "76a17912-0203-432c-ba5e-fbc7e08f54e7"). InnerVolumeSpecName "kube-api-access-4btx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:18:57.101660 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.101635    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-util" (OuterVolumeSpecName: "util") pod "76a17912-0203-432c-ba5e-fbc7e08f54e7" (UID: "76a17912-0203-432c-ba5e-fbc7e08f54e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:57.195333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.195303    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:57.195333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.195327    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a17912-0203-432c-ba5e-fbc7e08f54e7-util\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:57.195333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.195336    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4btx6\" (UniqueName: \"kubernetes.io/projected/76a17912-0203-432c-ba5e-fbc7e08f54e7-kube-api-access-4btx6\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:57.792394 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.792371    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r"
Jul 07 23:18:57.792828 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.792409    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r" event={"ID":"063d391d-607d-44a4-a558-b4403c5260e0","Type":"ContainerDied","Data":"2ca058e104ee78338bebb914e118ea8295ed7c9c0cde4bd0088cbde79dcb47de"}
Jul 07 23:18:57.792828 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.792454    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ca058e104ee78338bebb914e118ea8295ed7c9c0cde4bd0088cbde79dcb47de"
Jul 07 23:18:57.794328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.794296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg" event={"ID":"76a17912-0203-432c-ba5e-fbc7e08f54e7","Type":"ContainerDied","Data":"121f6d059b3f5f83dcdae8c5ce866613c81affd61f0d3ff3c12ffca3f380831b"}
Jul 07 23:18:57.794467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.794341    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="121f6d059b3f5f83dcdae8c5ce866613c81affd61f0d3ff3c12ffca3f380831b"
Jul 07 23:18:57.794467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.794306    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg"
Jul 07 23:18:57.937875 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:57.937847    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:58.006396 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.006361    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-util\") pod \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") "
Jul 07 23:18:58.006577 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.006417    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-bundle\") pod \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") "
Jul 07 23:18:58.006577 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.006466    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcmnc\" (UniqueName: \"kubernetes.io/projected/10a78d13-ae61-48dc-aff0-8fe2c79b2807-kube-api-access-xcmnc\") pod \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\" (UID: \"10a78d13-ae61-48dc-aff0-8fe2c79b2807\") "
Jul 07 23:18:58.006939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.006915    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-bundle" (OuterVolumeSpecName: "bundle") pod "10a78d13-ae61-48dc-aff0-8fe2c79b2807" (UID: "10a78d13-ae61-48dc-aff0-8fe2c79b2807"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:58.008584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.008554    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a78d13-ae61-48dc-aff0-8fe2c79b2807-kube-api-access-xcmnc" (OuterVolumeSpecName: "kube-api-access-xcmnc") pod "10a78d13-ae61-48dc-aff0-8fe2c79b2807" (UID: "10a78d13-ae61-48dc-aff0-8fe2c79b2807"). InnerVolumeSpecName "kube-api-access-xcmnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:18:58.012053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.012007    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-util" (OuterVolumeSpecName: "util") pod "10a78d13-ae61-48dc-aff0-8fe2c79b2807" (UID: "10a78d13-ae61-48dc-aff0-8fe2c79b2807"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:18:58.107720 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.107618    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-util\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:58.107720 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.107685    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10a78d13-ae61-48dc-aff0-8fe2c79b2807-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:58.107720 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.107700    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcmnc\" (UniqueName: \"kubernetes.io/projected/10a78d13-ae61-48dc-aff0-8fe2c79b2807-kube-api-access-xcmnc\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:18:58.801712 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.801684    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb"
Jul 07 23:18:58.802193 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.801716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb" event={"ID":"10a78d13-ae61-48dc-aff0-8fe2c79b2807","Type":"ContainerDied","Data":"d3ef47dd1292acaef6bcfa9ee5b564d1b106f700589c2548fa04493fbb051ab2"}
Jul 07 23:18:58.802193 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:18:58.801765    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3ef47dd1292acaef6bcfa9ee5b564d1b106f700589c2548fa04493fbb051ab2"
Jul 07 23:19:08.117549 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117514    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"]
Jul 07 23:19:08.117913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117886    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063d391d-607d-44a4-a558-b4403c5260e0" containerName="util"
Jul 07 23:19:08.117913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="063d391d-607d-44a4-a558-b4403c5260e0" containerName="util"
Jul 07 23:19:08.117913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117908    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerName="extract"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117917    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerName="extract"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117927    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerName="util"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117933    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerName="util"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117941    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerName="extract"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117946    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerName="extract"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117952    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerName="pull"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117957    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerName="pull"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117967    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063d391d-607d-44a4-a558-b4403c5260e0" containerName="pull"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117971    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="063d391d-607d-44a4-a558-b4403c5260e0" containerName="pull"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117979    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerName="util"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117983    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerName="util"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117990    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerName="util"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.117999    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerName="util"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118006    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerName="pull"
Jul 07 23:19:08.118005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118011    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerName="pull"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118018    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerName="pull"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118022    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerName="pull"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118034    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerName="extract"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118039    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerName="extract"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118046    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063d391d-607d-44a4-a558-b4403c5260e0" containerName="extract"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118052    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="063d391d-607d-44a4-a558-b4403c5260e0" containerName="extract"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118124    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d75dc54e-4c86-4c1b-ab46-7f805de3706c" containerName="extract"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118132    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a17912-0203-432c-ba5e-fbc7e08f54e7" containerName="extract"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118137    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a78d13-ae61-48dc-aff0-8fe2c79b2807" containerName="extract"
Jul 07 23:19:08.118451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.118144    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="063d391d-607d-44a4-a558-b4403c5260e0" containerName="extract"
Jul 07 23:19:08.121182 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.121165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"
Jul 07 23:19:08.123923 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.123898    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 23:19:08.124041 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.123937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gr98p\""
Jul 07 23:19:08.134799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.134780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"]
Jul 07 23:19:08.301796 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.301752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlr89\" (UniqueName: \"kubernetes.io/projected/563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9-kube-api-access-tlr89\") pod \"dns-operator-controller-manager-864dd78c4c-rt4w7\" (UID: \"563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"
Jul 07 23:19:08.402472 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.402385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlr89\" (UniqueName: \"kubernetes.io/projected/563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9-kube-api-access-tlr89\") pod \"dns-operator-controller-manager-864dd78c4c-rt4w7\" (UID: \"563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"
Jul 07 23:19:08.415151 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.415126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlr89\" (UniqueName: \"kubernetes.io/projected/563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9-kube-api-access-tlr89\") pod \"dns-operator-controller-manager-864dd78c4c-rt4w7\" (UID: \"563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"
Jul 07 23:19:08.431328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.431305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"
Jul 07 23:19:08.567367 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.567344    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"]
Jul 07 23:19:08.569228 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:08.569204    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563b4ac5_2eb2_4f7b_8c67_dac6c042e1a9.slice/crio-b00cf25d0c970179d7dea485ff22e4c64c57d8225f3bbb9c609de2e811ba29d3 WatchSource:0}: Error finding container b00cf25d0c970179d7dea485ff22e4c64c57d8225f3bbb9c609de2e811ba29d3: Status 404 returned error can't find the container with id b00cf25d0c970179d7dea485ff22e4c64c57d8225f3bbb9c609de2e811ba29d3
Jul 07 23:19:08.855233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:08.855200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7" event={"ID":"563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9","Type":"ContainerStarted","Data":"b00cf25d0c970179d7dea485ff22e4c64c57d8225f3bbb9c609de2e811ba29d3"}
Jul 07 23:19:10.696213 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:10.696192    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 23:19:10.869588 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:10.869550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7" event={"ID":"563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9","Type":"ContainerStarted","Data":"238db13317696568233ec34b24727bce1a3a47fd3266042f28c5e6f29eb144db"}
Jul 07 23:19:10.869775 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:10.869646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"
Jul 07 23:19:10.887473 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:10.887425    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7" podStartSLOduration=0.765303592 podStartE2EDuration="2.887412103s" totalImagesPullingTime="2.122108511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:10.886396955 +0000 UTC m=+482.106381046" watchObservedRunningTime="2026-07-07 23:19:10.887412103 +0000 UTC m=+482.107396192"
Jul 07 23:19:11.252037 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.252000    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67d8d5d97d-k8z65"]
Jul 07 23:19:11.256070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.256042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.269093 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.269068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d8d5d97d-k8z65"]
Jul 07 23:19:11.431518 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.431488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-service-ca\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.431669 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.431527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-oauth-serving-cert\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.431669 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.431555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-serving-cert\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.431669 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.431628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-trusted-ca-bundle\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.431761 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.431694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-oauth-config\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.431761 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.431712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggtf9\" (UniqueName: \"kubernetes.io/projected/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-kube-api-access-ggtf9\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.431761 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.431738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-config\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533171 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-service-ca\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533171 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-oauth-serving-cert\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533171 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-serving-cert\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-trusted-ca-bundle\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-oauth-config\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggtf9\" (UniqueName: \"kubernetes.io/projected/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-kube-api-access-ggtf9\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-config\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533806    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-service-ca\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.533950 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533925    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-oauth-serving-cert\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.534006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.533953    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-config\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.534042 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.534026    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-trusted-ca-bundle\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.536094 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.536069    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-oauth-config\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.536220 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.536199    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-console-serving-cert\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.541389 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.541368    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggtf9\" (UniqueName: \"kubernetes.io/projected/c779ccbc-1132-4076-83d3-fdbaa6b0d8ed-kube-api-access-ggtf9\") pod \"console-67d8d5d97d-k8z65\" (UID: \"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed\") " pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.566062 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.566035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:11.704691 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.704663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d8d5d97d-k8z65"]
Jul 07 23:19:11.705758 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:11.705734    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc779ccbc_1132_4076_83d3_fdbaa6b0d8ed.slice/crio-7b981b2e17b8627848d0658fee29b426a83d3d872bbadd4b64492504d3d2d94c WatchSource:0}: Error finding container 7b981b2e17b8627848d0658fee29b426a83d3d872bbadd4b64492504d3d2d94c: Status 404 returned error can't find the container with id 7b981b2e17b8627848d0658fee29b426a83d3d872bbadd4b64492504d3d2d94c
Jul 07 23:19:11.876233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.876199    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d8d5d97d-k8z65" event={"ID":"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed","Type":"ContainerStarted","Data":"a7ee45100cd719629c3f811099f5bd25b76f6142a622b73dc6c139b913b6a4bc"}
Jul 07 23:19:11.876471 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.876258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d8d5d97d-k8z65" event={"ID":"c779ccbc-1132-4076-83d3-fdbaa6b0d8ed","Type":"ContainerStarted","Data":"7b981b2e17b8627848d0658fee29b426a83d3d872bbadd4b64492504d3d2d94c"}
Jul 07 23:19:11.896085 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:11.896035    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67d8d5d97d-k8z65" podStartSLOduration=0.896019345 podStartE2EDuration="896.019345ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:11.894179218 +0000 UTC m=+483.114163308" watchObservedRunningTime="2026-07-07 23:19:11.896019345 +0000 UTC m=+483.116003433"
Jul 07 23:19:12.419436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.419401    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"]
Jul 07 23:19:12.423131 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.423092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"
Jul 07 23:19:12.425592 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.425573    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5plgm\""
Jul 07 23:19:12.434263 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.434238    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"]
Jul 07 23:19:12.543902 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.543866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h2qr\" (UniqueName: \"kubernetes.io/projected/ccbd60be-5bf2-49ee-8336-54505da3e15c-kube-api-access-4h2qr\") pod \"authorino-operator-75cc8d5cb7-6vfnv\" (UID: \"ccbd60be-5bf2-49ee-8336-54505da3e15c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"
Jul 07 23:19:12.644506 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.644467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h2qr\" (UniqueName: \"kubernetes.io/projected/ccbd60be-5bf2-49ee-8336-54505da3e15c-kube-api-access-4h2qr\") pod \"authorino-operator-75cc8d5cb7-6vfnv\" (UID: \"ccbd60be-5bf2-49ee-8336-54505da3e15c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"
Jul 07 23:19:12.662842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.662804    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h2qr\" (UniqueName: \"kubernetes.io/projected/ccbd60be-5bf2-49ee-8336-54505da3e15c-kube-api-access-4h2qr\") pod \"authorino-operator-75cc8d5cb7-6vfnv\" (UID: \"ccbd60be-5bf2-49ee-8336-54505da3e15c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"
Jul 07 23:19:12.734432 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.734342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"
Jul 07 23:19:12.867979 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.867953    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"]
Jul 07 23:19:12.869636 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:12.869609    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbd60be_5bf2_49ee_8336_54505da3e15c.slice/crio-5c4e9641af31800bbfc985c0b18661bbed1544583c7305a26037ef7acd4af16b WatchSource:0}: Error finding container 5c4e9641af31800bbfc985c0b18661bbed1544583c7305a26037ef7acd4af16b: Status 404 returned error can't find the container with id 5c4e9641af31800bbfc985c0b18661bbed1544583c7305a26037ef7acd4af16b
Jul 07 23:19:12.882798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:12.882769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv" event={"ID":"ccbd60be-5bf2-49ee-8336-54505da3e15c","Type":"ContainerStarted","Data":"5c4e9641af31800bbfc985c0b18661bbed1544583c7305a26037ef7acd4af16b"}
Jul 07 23:19:15.900591 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:15.900554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv" event={"ID":"ccbd60be-5bf2-49ee-8336-54505da3e15c","Type":"ContainerStarted","Data":"7e0d60adc8f3274ecb3745e88bb4cf073142103fb384eb0f44744814dfe82613"}
Jul 07 23:19:15.901033 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:15.900637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"
Jul 07 23:19:15.918520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:15.918474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv" podStartSLOduration=1.7414934739999999 podStartE2EDuration="3.918460895s" totalImagesPullingTime="2.176967421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:15.915870886 +0000 UTC m=+487.135854975" watchObservedRunningTime="2026-07-07 23:19:15.918460895 +0000 UTC m=+487.138444984"
Jul 07 23:19:17.658199 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.658161    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"]
Jul 07 23:19:17.661605 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.661590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:17.664252 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.664231    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mkt55\""
Jul 07 23:19:17.678072 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.678042    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"]
Jul 07 23:19:17.688965 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.688933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ab24de-658a-4d92-a731-543b32888bcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:17.689284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.689014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgdq5\" (UniqueName: \"kubernetes.io/projected/b8ab24de-658a-4d92-a731-543b32888bcf-kube-api-access-lgdq5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:17.790487 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.790451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ab24de-658a-4d92-a731-543b32888bcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:17.790656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.790504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdq5\" (UniqueName: \"kubernetes.io/projected/b8ab24de-658a-4d92-a731-543b32888bcf-kube-api-access-lgdq5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:17.790857 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.790838    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ab24de-658a-4d92-a731-543b32888bcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:17.799870 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.799844    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgdq5\" (UniqueName: \"kubernetes.io/projected/b8ab24de-658a-4d92-a731-543b32888bcf-kube-api-access-lgdq5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:17.971578 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:17.971488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:18.108739 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:18.108713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"]
Jul 07 23:19:18.110765 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:18.110741    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ab24de_658a_4d92_a731_543b32888bcf.slice/crio-57ffb4d8f30dc659cdac9d9dcd05c431712e3ae59aa25bae9ed6ac7f3eb022a6 WatchSource:0}: Error finding container 57ffb4d8f30dc659cdac9d9dcd05c431712e3ae59aa25bae9ed6ac7f3eb022a6: Status 404 returned error can't find the container with id 57ffb4d8f30dc659cdac9d9dcd05c431712e3ae59aa25bae9ed6ac7f3eb022a6
Jul 07 23:19:18.917503 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:18.917466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7" event={"ID":"b8ab24de-658a-4d92-a731-543b32888bcf","Type":"ContainerStarted","Data":"57ffb4d8f30dc659cdac9d9dcd05c431712e3ae59aa25bae9ed6ac7f3eb022a6"}
Jul 07 23:19:19.764700 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:19.764662    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"]
Jul 07 23:19:19.768068 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:19.768052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:19.770666 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:19.770636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dd8b9\""
Jul 07 23:19:19.779429 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:19.779408    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"]
Jul 07 23:19:19.808585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:19.808559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg5dv\" (UniqueName: \"kubernetes.io/projected/b6f83647-deb2-43a9-b9f4-9f3665ab4c91-kube-api-access-jg5dv\") pod \"limitador-operator-controller-manager-859d7b78bd-f8665\" (UID: \"b6f83647-deb2-43a9-b9f4-9f3665ab4c91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:19.909943 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:19.909903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg5dv\" (UniqueName: \"kubernetes.io/projected/b6f83647-deb2-43a9-b9f4-9f3665ab4c91-kube-api-access-jg5dv\") pod \"limitador-operator-controller-manager-859d7b78bd-f8665\" (UID: \"b6f83647-deb2-43a9-b9f4-9f3665ab4c91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:19.921332 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:19.921299    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg5dv\" (UniqueName: \"kubernetes.io/projected/b6f83647-deb2-43a9-b9f4-9f3665ab4c91-kube-api-access-jg5dv\") pod \"limitador-operator-controller-manager-859d7b78bd-f8665\" (UID: \"b6f83647-deb2-43a9-b9f4-9f3665ab4c91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:20.079158 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:20.079118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:20.218918 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:20.218890    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"]
Jul 07 23:19:20.221412 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:20.221384    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f83647_deb2_43a9_b9f4_9f3665ab4c91.slice/crio-60520bc2068225e79d969222ebdc44558642c3ca78ea9c2de5f12b0392a2cce9 WatchSource:0}: Error finding container 60520bc2068225e79d969222ebdc44558642c3ca78ea9c2de5f12b0392a2cce9: Status 404 returned error can't find the container with id 60520bc2068225e79d969222ebdc44558642c3ca78ea9c2de5f12b0392a2cce9
Jul 07 23:19:20.936929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:20.936844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665" event={"ID":"b6f83647-deb2-43a9-b9f4-9f3665ab4c91","Type":"ContainerStarted","Data":"60520bc2068225e79d969222ebdc44558642c3ca78ea9c2de5f12b0392a2cce9"}
Jul 07 23:19:21.566521 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:21.566493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:21.566745 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:21.566726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:21.571947 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:21.571921    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:21.879879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:21.879248    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rt4w7"
Jul 07 23:19:21.949429 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:21.949405    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67d8d5d97d-k8z65"
Jul 07 23:19:21.998349 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:21.998317    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c8694fc64-b6hpt"]
Jul 07 23:19:22.952387 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:22.952352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665" event={"ID":"b6f83647-deb2-43a9-b9f4-9f3665ab4c91","Type":"ContainerStarted","Data":"610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900"}
Jul 07 23:19:22.952832 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:22.952631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:22.969303 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:22.969254    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665" podStartSLOduration=2.276862386 podStartE2EDuration="3.969240483s" totalImagesPullingTime="1.692378097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:22.968430315 +0000 UTC m=+494.188414406" watchObservedRunningTime="2026-07-07 23:19:22.969240483 +0000 UTC m=+494.189224571"
Jul 07 23:19:23.959170 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:23.959133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7" event={"ID":"b8ab24de-658a-4d92-a731-543b32888bcf","Type":"ContainerStarted","Data":"b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8"}
Jul 07 23:19:23.959505 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:23.959439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:23.982390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:23.982347    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7" podStartSLOduration=1.229758864 podStartE2EDuration="6.982333695s" totalImagesPullingTime="5.752574831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:23.98021935 +0000 UTC m=+495.200203440" watchObservedRunningTime="2026-07-07 23:19:23.982333695 +0000 UTC m=+495.202317784"
Jul 07 23:19:26.602201 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.602157    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"]
Jul 07 23:19:26.605959 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.605936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.608507 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.608482    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 23:19:26.608643 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.608626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d6jqq\""
Jul 07 23:19:26.608690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.608626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 23:19:26.619585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.619232    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"]
Jul 07 23:19:26.669456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.669429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ca10a0-ba6f-493b-b718-a928190b6084-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.669603 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.669465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58ca10a0-ba6f-493b-b718-a928190b6084-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.669603 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.669485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tg2g\" (UniqueName: \"kubernetes.io/projected/58ca10a0-ba6f-493b-b718-a928190b6084-kube-api-access-8tg2g\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.770992 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.770958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ca10a0-ba6f-493b-b718-a928190b6084-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.771167 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.771000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58ca10a0-ba6f-493b-b718-a928190b6084-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.771167 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.771032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tg2g\" (UniqueName: \"kubernetes.io/projected/58ca10a0-ba6f-493b-b718-a928190b6084-kube-api-access-8tg2g\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.771789 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.771770    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58ca10a0-ba6f-493b-b718-a928190b6084-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.773265 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.773241    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ca10a0-ba6f-493b-b718-a928190b6084-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.779314 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.779291    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tg2g\" (UniqueName: \"kubernetes.io/projected/58ca10a0-ba6f-493b-b718-a928190b6084-kube-api-access-8tg2g\") pod \"kuadrant-console-plugin-66b5774985-nsw2s\" (UID: \"58ca10a0-ba6f-493b-b718-a928190b6084\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:26.908781 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.908705    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6vfnv"
Jul 07 23:19:26.921906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:26.921880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"
Jul 07 23:19:27.069164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:27.069137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s"]
Jul 07 23:19:27.070305 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:27.070283    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58ca10a0_ba6f_493b_b718_a928190b6084.slice/crio-5596e857e443b1b5661cdec040523adbd3b5f35579e617da1c05eaad6857a119 WatchSource:0}: Error finding container 5596e857e443b1b5661cdec040523adbd3b5f35579e617da1c05eaad6857a119: Status 404 returned error can't find the container with id 5596e857e443b1b5661cdec040523adbd3b5f35579e617da1c05eaad6857a119
Jul 07 23:19:27.982962 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:27.982929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s" event={"ID":"58ca10a0-ba6f-493b-b718-a928190b6084","Type":"ContainerStarted","Data":"5596e857e443b1b5661cdec040523adbd3b5f35579e617da1c05eaad6857a119"}
Jul 07 23:19:33.961516 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:33.961482    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:34.967245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:34.967206    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:35.889041 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:35.889006    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"]
Jul 07 23:19:35.896215 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:35.896191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:35.908671 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:35.908635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"]
Jul 07 23:19:35.959513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:35.959474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467qb\" (UniqueName: \"kubernetes.io/projected/c8ee5e37-70de-4f43-b11c-f39664e54425-kube-api-access-467qb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:35.959705 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:35.959638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ee5e37-70de-4f43-b11c-f39664e54425-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:36.060587 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.060545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ee5e37-70de-4f43-b11c-f39664e54425-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:36.061043 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.060643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467qb\" (UniqueName: \"kubernetes.io/projected/c8ee5e37-70de-4f43-b11c-f39664e54425-kube-api-access-467qb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:36.061043 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.060998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ee5e37-70de-4f43-b11c-f39664e54425-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:36.070910 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.070871    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-467qb\" (UniqueName: \"kubernetes.io/projected/c8ee5e37-70de-4f43-b11c-f39664e54425-kube-api-access-467qb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:36.212347 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.212252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:36.669539 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.669497    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"]
Jul 07 23:19:36.675439 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.675409    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"]
Jul 07 23:19:36.688812 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.688782    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"]
Jul 07 23:19:36.689029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.689003    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" containerName="manager" containerID="cri-o://b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8" gracePeriod=2
Jul 07 23:19:36.691430 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:36.691390    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:36.696117 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.694249    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"]
Jul 07 23:19:36.707143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.706737    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"]
Jul 07 23:19:36.707143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.706872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:36.713754 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:36.712938    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:36.715807 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.715782    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"]
Jul 07 23:19:36.718392 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.718368    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"]
Jul 07 23:19:36.718666 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.718626    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" containerName="manager" containerID="cri-o://610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900" gracePeriod=2
Jul 07 23:19:36.722913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.722867    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"]
Jul 07 23:19:36.723504 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.723488    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" containerName="manager"
Jul 07 23:19:36.723603 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.723553    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" containerName="manager"
Jul 07 23:19:36.723733 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.723719    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" containerName="manager"
Jul 07 23:19:36.727521 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.727497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:36.734798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.734732    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"]
Jul 07 23:19:36.737898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.737859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"]
Jul 07 23:19:36.743473 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:36.743442    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f8665\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:36.745535 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:36.745496    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:36.747037 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.747015    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"]
Jul 07 23:19:36.747520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.747504    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" containerName="manager"
Jul 07 23:19:36.747597 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.747525    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" containerName="manager"
Jul 07 23:19:36.747661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.747645    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" containerName="manager"
Jul 07 23:19:36.751017 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.750999    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"
Jul 07 23:19:36.759624 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.759588    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"]
Jul 07 23:19:36.768164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.768136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b621048c-fa6a-445e-adc6-7b6b14224bc1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qdmxs\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:36.768273 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.768186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddr2q\" (UniqueName: \"kubernetes.io/projected/b621048c-fa6a-445e-adc6-7b6b14224bc1-kube-api-access-ddr2q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qdmxs\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:36.777604 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:36.777537    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f8665\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:36.796451 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:36.796407    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:36.869438 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.869395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zln7z\" (UniqueName: \"kubernetes.io/projected/553d7e56-df5b-43e3-b11c-06f12cec0f9a-kube-api-access-zln7z\") pod \"limitador-operator-controller-manager-859d7b78bd-8jd24\" (UID: \"553d7e56-df5b-43e3-b11c-06f12cec0f9a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"
Jul 07 23:19:36.869629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.869489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg6h4\" (UniqueName: \"kubernetes.io/projected/bd51673c-333b-4ea0-883e-360137dd4c07-kube-api-access-fg6h4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-86jpq\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:36.869629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.869566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b621048c-fa6a-445e-adc6-7b6b14224bc1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qdmxs\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:36.869629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.869620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd51673c-333b-4ea0-883e-360137dd4c07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-86jpq\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:36.869804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.869671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddr2q\" (UniqueName: \"kubernetes.io/projected/b621048c-fa6a-445e-adc6-7b6b14224bc1-kube-api-access-ddr2q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qdmxs\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:36.869933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.869918    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b621048c-fa6a-445e-adc6-7b6b14224bc1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qdmxs\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:36.880830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.880802    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddr2q\" (UniqueName: \"kubernetes.io/projected/b621048c-fa6a-445e-adc6-7b6b14224bc1-kube-api-access-ddr2q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qdmxs\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:36.970810 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.970730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd51673c-333b-4ea0-883e-360137dd4c07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-86jpq\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:36.970988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.970854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zln7z\" (UniqueName: \"kubernetes.io/projected/553d7e56-df5b-43e3-b11c-06f12cec0f9a-kube-api-access-zln7z\") pod \"limitador-operator-controller-manager-859d7b78bd-8jd24\" (UID: \"553d7e56-df5b-43e3-b11c-06f12cec0f9a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"
Jul 07 23:19:36.970988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.970889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg6h4\" (UniqueName: \"kubernetes.io/projected/bd51673c-333b-4ea0-883e-360137dd4c07-kube-api-access-fg6h4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-86jpq\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:36.971237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.971208    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd51673c-333b-4ea0-883e-360137dd4c07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-86jpq\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:36.985317 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.985283    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zln7z\" (UniqueName: \"kubernetes.io/projected/553d7e56-df5b-43e3-b11c-06f12cec0f9a-kube-api-access-zln7z\") pod \"limitador-operator-controller-manager-859d7b78bd-8jd24\" (UID: \"553d7e56-df5b-43e3-b11c-06f12cec0f9a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"
Jul 07 23:19:36.985461 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:36.985286    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg6h4\" (UniqueName: \"kubernetes.io/projected/bd51673c-333b-4ea0-883e-360137dd4c07-kube-api-access-fg6h4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-86jpq\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:37.105312 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:37.105280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:37.114073 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:37.114046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:37.121145 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:37.121121    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"
Jul 07 23:19:47.028114 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:47.028062    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c8694fc64-b6hpt" podUID="91a1401d-dfe4-46ca-8762-e85e7d67997d" containerName="console" containerID="cri-o://610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143" gracePeriod=15
Jul 07 23:19:48.496830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:48.496798    2581 patch_prober.go:28] interesting pod/console-6c8694fc64-b6hpt container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused" start-of-body=
Jul 07 23:19:48.497245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:48.496852    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6c8694fc64-b6hpt" podUID="91a1401d-dfe4-46ca-8762-e85e7d67997d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 07 23:19:49.754074 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.754046    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:49.756718 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:49.756659    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f8665\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:49.769782 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.769542    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:19:49.791399 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:49.784338    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f8665\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:49.821816 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.821786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"]
Jul 07 23:19:49.824463 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:49.824438    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd51673c_333b_4ea0_883e_360137dd4c07.slice/crio-d6de6808bdd1c0506fcf85fabb843f84a75fd4ec8d8f38582f0c374040644081 WatchSource:0}: Error finding container d6de6808bdd1c0506fcf85fabb843f84a75fd4ec8d8f38582f0c374040644081: Status 404 returned error can't find the container with id d6de6808bdd1c0506fcf85fabb843f84a75fd4ec8d8f38582f0c374040644081
Jul 07 23:19:49.825613 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.825588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:49.828404 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:49.828371    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:49.830287 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:49.830258    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f8665\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:49.857895 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.857864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"]
Jul 07 23:19:49.860230 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:49.860203    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb621048c_fa6a_445e_adc6_7b6b14224bc1.slice/crio-c4174a70022294a9369dc65ff5d355fd34b0b837291282f57444120e2120b598 WatchSource:0}: Error finding container c4174a70022294a9369dc65ff5d355fd34b0b837291282f57444120e2120b598: Status 404 returned error can't find the container with id c4174a70022294a9369dc65ff5d355fd34b0b837291282f57444120e2120b598
Jul 07 23:19:49.860925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.860906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"]
Jul 07 23:19:49.861445 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:19:49.861423    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553d7e56_df5b_43e3_b11c_06f12cec0f9a.slice/crio-b8e1f6ed32ed871b1c18944c2e5f734e7f2277dae0c5dc8829d1ebdc7292d6d1 WatchSource:0}: Error finding container b8e1f6ed32ed871b1c18944c2e5f734e7f2277dae0c5dc8829d1ebdc7292d6d1: Status 404 returned error can't find the container with id b8e1f6ed32ed871b1c18944c2e5f734e7f2277dae0c5dc8829d1ebdc7292d6d1
Jul 07 23:19:49.900345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900323    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-config\") pod \"91a1401d-dfe4-46ca-8762-e85e7d67997d\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") "
Jul 07 23:19:49.900453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg5dv\" (UniqueName: \"kubernetes.io/projected/b6f83647-deb2-43a9-b9f4-9f3665ab4c91-kube-api-access-jg5dv\") pod \"b6f83647-deb2-43a9-b9f4-9f3665ab4c91\" (UID: \"b6f83647-deb2-43a9-b9f4-9f3665ab4c91\") "
Jul 07 23:19:49.900523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900481    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-serving-cert\") pod \"91a1401d-dfe4-46ca-8762-e85e7d67997d\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") "
Jul 07 23:19:49.900583 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900534    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-oauth-config\") pod \"91a1401d-dfe4-46ca-8762-e85e7d67997d\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") "
Jul 07 23:19:49.900643 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900595    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzmb\" (UniqueName: \"kubernetes.io/projected/91a1401d-dfe4-46ca-8762-e85e7d67997d-kube-api-access-qpzmb\") pod \"91a1401d-dfe4-46ca-8762-e85e7d67997d\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") "
Jul 07 23:19:49.900643 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-service-ca\") pod \"91a1401d-dfe4-46ca-8762-e85e7d67997d\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") "
Jul 07 23:19:49.900743 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900683    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-config" (OuterVolumeSpecName: "console-config") pod "91a1401d-dfe4-46ca-8762-e85e7d67997d" (UID: "91a1401d-dfe4-46ca-8762-e85e7d67997d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:19:49.900743 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-trusted-ca-bundle\") pod \"91a1401d-dfe4-46ca-8762-e85e7d67997d\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") "
Jul 07 23:19:49.900743 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.900736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-oauth-serving-cert\") pod \"91a1401d-dfe4-46ca-8762-e85e7d67997d\" (UID: \"91a1401d-dfe4-46ca-8762-e85e7d67997d\") "
Jul 07 23:19:49.901153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.901135    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:49.901393 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.901366    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-service-ca" (OuterVolumeSpecName: "service-ca") pod "91a1401d-dfe4-46ca-8762-e85e7d67997d" (UID: "91a1401d-dfe4-46ca-8762-e85e7d67997d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:19:49.901483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.901425    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91a1401d-dfe4-46ca-8762-e85e7d67997d" (UID: "91a1401d-dfe4-46ca-8762-e85e7d67997d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:19:49.901593 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.901565    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91a1401d-dfe4-46ca-8762-e85e7d67997d" (UID: "91a1401d-dfe4-46ca-8762-e85e7d67997d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:19:49.902651 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.902627    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f83647-deb2-43a9-b9f4-9f3665ab4c91-kube-api-access-jg5dv" (OuterVolumeSpecName: "kube-api-access-jg5dv") pod "b6f83647-deb2-43a9-b9f4-9f3665ab4c91" (UID: "b6f83647-deb2-43a9-b9f4-9f3665ab4c91"). InnerVolumeSpecName "kube-api-access-jg5dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:19:49.903349 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.903321    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91a1401d-dfe4-46ca-8762-e85e7d67997d" (UID: "91a1401d-dfe4-46ca-8762-e85e7d67997d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:19:49.903431 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.903368    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a1401d-dfe4-46ca-8762-e85e7d67997d-kube-api-access-qpzmb" (OuterVolumeSpecName: "kube-api-access-qpzmb") pod "91a1401d-dfe4-46ca-8762-e85e7d67997d" (UID: "91a1401d-dfe4-46ca-8762-e85e7d67997d"). InnerVolumeSpecName "kube-api-access-qpzmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:19:49.903520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:49.903495    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91a1401d-dfe4-46ca-8762-e85e7d67997d" (UID: "91a1401d-dfe4-46ca-8762-e85e7d67997d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:19:50.001905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.001860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgdq5\" (UniqueName: \"kubernetes.io/projected/b8ab24de-658a-4d92-a731-543b32888bcf-kube-api-access-lgdq5\") pod \"b8ab24de-658a-4d92-a731-543b32888bcf\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") "
Jul 07 23:19:50.002087 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.001953    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ab24de-658a-4d92-a731-543b32888bcf-extensions-socket-volume\") pod \"b8ab24de-658a-4d92-a731-543b32888bcf\" (UID: \"b8ab24de-658a-4d92-a731-543b32888bcf\") "
Jul 07 23:19:50.002161 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002092    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-oauth-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.002161 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002130    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg5dv\" (UniqueName: \"kubernetes.io/projected/b6f83647-deb2-43a9-b9f4-9f3665ab4c91-kube-api-access-jg5dv\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.002161 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002140    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-serving-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.002161 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002152    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1401d-dfe4-46ca-8762-e85e7d67997d-console-oauth-config\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.002296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002165    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpzmb\" (UniqueName: \"kubernetes.io/projected/91a1401d-dfe4-46ca-8762-e85e7d67997d-kube-api-access-qpzmb\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.002296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002177    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.002296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002185    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1401d-dfe4-46ca-8762-e85e7d67997d-trusted-ca-bundle\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.002390 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.002373    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ab24de-658a-4d92-a731-543b32888bcf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b8ab24de-658a-4d92-a731-543b32888bcf" (UID: "b8ab24de-658a-4d92-a731-543b32888bcf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:19:50.003829 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.003809    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ab24de-658a-4d92-a731-543b32888bcf-kube-api-access-lgdq5" (OuterVolumeSpecName: "kube-api-access-lgdq5") pod "b8ab24de-658a-4d92-a731-543b32888bcf" (UID: "b8ab24de-658a-4d92-a731-543b32888bcf"). InnerVolumeSpecName "kube-api-access-lgdq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:19:50.102919 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.102841    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ab24de-658a-4d92-a731-543b32888bcf-extensions-socket-volume\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.102919 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.102867    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgdq5\" (UniqueName: \"kubernetes.io/projected/b8ab24de-658a-4d92-a731-543b32888bcf-kube-api-access-lgdq5\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:50.132623 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.132576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq" event={"ID":"bd51673c-333b-4ea0-883e-360137dd4c07","Type":"ContainerStarted","Data":"b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f"}
Jul 07 23:19:50.132801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.132640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq" event={"ID":"bd51673c-333b-4ea0-883e-360137dd4c07","Type":"ContainerStarted","Data":"d6de6808bdd1c0506fcf85fabb843f84a75fd4ec8d8f38582f0c374040644081"}
Jul 07 23:19:50.132801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.132767    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:19:50.134651 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.134619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s" event={"ID":"58ca10a0-ba6f-493b-b718-a928190b6084","Type":"ContainerStarted","Data":"b0a8e81ec937e8faaee5b9dbe0377db07f17b0e212b010d22d86ec2e8fa3b938"}
Jul 07 23:19:50.135012 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:50.134981    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f8665\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:50.136130 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.136085    2581 generic.go:356] "Generic (PLEG): container finished" podID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" containerID="610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900" exitCode=0
Jul 07 23:19:50.136239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.136141    2581 scope.go:117] "RemoveContainer" containerID="610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900"
Jul 07 23:19:50.136239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.136154    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:50.137235 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:50.137209    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:50.138175 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.138074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs" event={"ID":"b621048c-fa6a-445e-adc6-7b6b14224bc1","Type":"ContainerStarted","Data":"5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34"}
Jul 07 23:19:50.138175 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.138142    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:19:50.138175 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.138166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs" event={"ID":"b621048c-fa6a-445e-adc6-7b6b14224bc1","Type":"ContainerStarted","Data":"c4174a70022294a9369dc65ff5d355fd34b0b837291282f57444120e2120b598"}
Jul 07 23:19:50.139702 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.139681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24" event={"ID":"553d7e56-df5b-43e3-b11c-06f12cec0f9a","Type":"ContainerStarted","Data":"5d9d97961ffc434eeb5b8687811f1e6c421bc5bc355d3db6574399a7c414899c"}
Jul 07 23:19:50.139804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.139725    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24" event={"ID":"553d7e56-df5b-43e3-b11c-06f12cec0f9a","Type":"ContainerStarted","Data":"b8e1f6ed32ed871b1c18944c2e5f734e7f2277dae0c5dc8829d1ebdc7292d6d1"}
Jul 07 23:19:50.139804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.139752    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"
Jul 07 23:19:50.141283 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.141189    2581 generic.go:356] "Generic (PLEG): container finished" podID="91a1401d-dfe4-46ca-8762-e85e7d67997d" containerID="610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143" exitCode=0
Jul 07 23:19:50.141283 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.141221    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8694fc64-b6hpt"
Jul 07 23:19:50.141283 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.141264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8694fc64-b6hpt" event={"ID":"91a1401d-dfe4-46ca-8762-e85e7d67997d","Type":"ContainerDied","Data":"610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143"}
Jul 07 23:19:50.141495 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.141300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8694fc64-b6hpt" event={"ID":"91a1401d-dfe4-46ca-8762-e85e7d67997d","Type":"ContainerDied","Data":"3e4fe2c0eeee1ad310a5288bfda23d1a4f31ca367551f5d398b78a2e45bfeb23"}
Jul 07 23:19:50.142784 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.142734    2581 generic.go:356] "Generic (PLEG): container finished" podID="b8ab24de-658a-4d92-a731-543b32888bcf" containerID="b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8" exitCode=0
Jul 07 23:19:50.142784 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.142778    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:50.147331 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.147314    2581 scope.go:117] "RemoveContainer" containerID="610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900"
Jul 07 23:19:50.147591 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:50.147570    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900\": container with ID starting with 610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900 not found: ID does not exist" containerID="610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900"
Jul 07 23:19:50.147647 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.147597    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900"} err="failed to get container status \"610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900\": rpc error: code = NotFound desc = could not find container \"610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900\": container with ID starting with 610d8eb65f82bdecb67cf132d6afadeeeb5abc251dd8ccef68062ea3fb38c900 not found: ID does not exist"
Jul 07 23:19:50.147647 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.147618    2581 scope.go:117] "RemoveContainer" containerID="610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143"
Jul 07 23:19:50.156259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.156240    2581 scope.go:117] "RemoveContainer" containerID="610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143"
Jul 07 23:19:50.156504 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:50.156487    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143\": container with ID starting with 610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143 not found: ID does not exist" containerID="610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143"
Jul 07 23:19:50.156550 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.156510    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143"} err="failed to get container status \"610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143\": rpc error: code = NotFound desc = could not find container \"610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143\": container with ID starting with 610bc206a298158c90d77e77624dcdfcf50e16cc8e13afe2f38f80ae13b3a143 not found: ID does not exist"
Jul 07 23:19:50.156550 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.156524    2581 scope.go:117] "RemoveContainer" containerID="b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8"
Jul 07 23:19:50.157702 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.157669    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq" podStartSLOduration=14.157657263 podStartE2EDuration="14.157657263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:50.157013812 +0000 UTC m=+521.376997908" watchObservedRunningTime="2026-07-07 23:19:50.157657263 +0000 UTC m=+521.377641430"
Jul 07 23:19:50.159060 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:50.159035    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgxb7\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxb7"
Jul 07 23:19:50.164691 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.164672    2581 scope.go:117] "RemoveContainer" containerID="b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8"
Jul 07 23:19:50.165009 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:50.164980    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8\": container with ID starting with b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8 not found: ID does not exist" containerID="b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8"
Jul 07 23:19:50.165110 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.165015    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8"} err="failed to get container status \"b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8\": rpc error: code = NotFound desc = could not find container \"b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8\": container with ID starting with b9ee3dbabd374c0ed08d29bc21f50be663d678549fcccdd0448bd9998d1edff8 not found: ID does not exist"
Jul 07 23:19:50.181110 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.181065    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs" podStartSLOduration=14.181054359 podStartE2EDuration="14.181054359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:50.179902006 +0000 UTC m=+521.399886095" watchObservedRunningTime="2026-07-07 23:19:50.181054359 +0000 UTC m=+521.401038447"
Jul 07 23:19:50.195257 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.195221    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nsw2s" podStartSLOduration=1.62405245 podStartE2EDuration="24.195209062s" totalImagesPullingTime="22.571156612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:50.193526459 +0000 UTC m=+521.413510561" watchObservedRunningTime="2026-07-07 23:19:50.195209062 +0000 UTC m=+521.415193149"
Jul 07 23:19:50.209600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.209563    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c8694fc64-b6hpt"]
Jul 07 23:19:50.213740 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:50.213708    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f8665\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f8665"
Jul 07 23:19:50.215925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.215905    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c8694fc64-b6hpt"]
Jul 07 23:19:50.243603 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:50.243536    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24" podStartSLOduration=14.243514906 podStartE2EDuration="14.243514906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:50.229747402 +0000 UTC m=+521.449731492" watchObservedRunningTime="2026-07-07 23:19:50.243514906 +0000 UTC m=+521.463499000"
Jul 07 23:19:51.503171 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:51.503139    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a1401d-dfe4-46ca-8762-e85e7d67997d" path="/var/lib/kubelet/pods/91a1401d-dfe4-46ca-8762-e85e7d67997d/volumes"
Jul 07 23:19:51.503533 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:51.503451    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f83647-deb2-43a9-b9f4-9f3665ab4c91" path="/var/lib/kubelet/pods/b6f83647-deb2-43a9-b9f4-9f3665ab4c91/volumes"
Jul 07 23:19:51.503755 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:51.503742    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ab24de-658a-4d92-a731-543b32888bcf" path="/var/lib/kubelet/pods/b8ab24de-658a-4d92-a731-543b32888bcf/volumes"
Jul 07 23:19:52.143969 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:52.143934    2581 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-vwccp_kuadrant-system_c8ee5e37-70de-4f43-b11c-f39664e54425_0(9096625fcfce18f65342d949b1fae9c0cd219cfd41724d15c60d1c4064aa3a29): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-vwccp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 07 23:19:52.144040 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:52.143995    2581 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-vwccp_kuadrant-system_c8ee5e37-70de-4f43-b11c-f39664e54425_0(9096625fcfce18f65342d949b1fae9c0cd219cfd41724d15c60d1c4064aa3a29): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-vwccp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:52.157361 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.157337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:52.160244 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:52.160212    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="c8ee5e37-70de-4f43-b11c-f39664e54425" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:52.164051 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.164032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:52.166200 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:52.166174    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="c8ee5e37-70de-4f43-b11c-f39664e54425" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:52.320661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.320627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ee5e37-70de-4f43-b11c-f39664e54425-extensions-socket-volume\") pod \"c8ee5e37-70de-4f43-b11c-f39664e54425\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") "
Jul 07 23:19:52.320661 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.320668    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-467qb\" (UniqueName: \"kubernetes.io/projected/c8ee5e37-70de-4f43-b11c-f39664e54425-kube-api-access-467qb\") pod \"c8ee5e37-70de-4f43-b11c-f39664e54425\" (UID: \"c8ee5e37-70de-4f43-b11c-f39664e54425\") "
Jul 07 23:19:52.320977 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.320952    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ee5e37-70de-4f43-b11c-f39664e54425-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c8ee5e37-70de-4f43-b11c-f39664e54425" (UID: "c8ee5e37-70de-4f43-b11c-f39664e54425"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:19:52.322877 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.322847    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ee5e37-70de-4f43-b11c-f39664e54425-kube-api-access-467qb" (OuterVolumeSpecName: "kube-api-access-467qb") pod "c8ee5e37-70de-4f43-b11c-f39664e54425" (UID: "c8ee5e37-70de-4f43-b11c-f39664e54425"). InnerVolumeSpecName "kube-api-access-467qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:19:52.421616 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.421521    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ee5e37-70de-4f43-b11c-f39664e54425-extensions-socket-volume\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:52.421616 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:52.421561    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-467qb\" (UniqueName: \"kubernetes.io/projected/c8ee5e37-70de-4f43-b11c-f39664e54425-kube-api-access-467qb\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:19:53.162748 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:53.162717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:53.165201 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:53.165174    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="c8ee5e37-70de-4f43-b11c-f39664e54425" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:53.170405 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:19:53.170372    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vwccp\" is forbidden: User \"system:node:ip-10-0-137-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-221.ec2.internal' and this object" podUID="c8ee5e37-70de-4f43-b11c-f39664e54425" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vwccp"
Jul 07 23:19:53.505491 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:19:53.505407    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ee5e37-70de-4f43-b11c-f39664e54425" path="/var/lib/kubelet/pods/c8ee5e37-70de-4f43-b11c-f39664e54425/volumes"
Jul 07 23:20:01.153520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.153435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jd24"
Jul 07 23:20:01.153520 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.153515    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:20:01.154048 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.153666    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:20:01.257415 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.257384    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"]
Jul 07 23:20:01.257612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.257582    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq" podUID="bd51673c-333b-4ea0-883e-360137dd4c07" containerName="manager" containerID="cri-o://b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f" gracePeriod=10
Jul 07 23:20:01.505195 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.505164    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"]
Jul 07 23:20:01.505787 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.505769    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a1401d-dfe4-46ca-8762-e85e7d67997d" containerName="console"
Jul 07 23:20:01.505833 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.505792    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a1401d-dfe4-46ca-8762-e85e7d67997d" containerName="console"
Jul 07 23:20:01.505917 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.505906    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a1401d-dfe4-46ca-8762-e85e7d67997d" containerName="console"
Jul 07 23:20:01.513898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.513875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.515714 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.515693    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:20:01.524176 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.524154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"]
Jul 07 23:20:01.602946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.602331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd51673c-333b-4ea0-883e-360137dd4c07-extensions-socket-volume\") pod \"bd51673c-333b-4ea0-883e-360137dd4c07\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") "
Jul 07 23:20:01.602946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.602465    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg6h4\" (UniqueName: \"kubernetes.io/projected/bd51673c-333b-4ea0-883e-360137dd4c07-kube-api-access-fg6h4\") pod \"bd51673c-333b-4ea0-883e-360137dd4c07\" (UID: \"bd51673c-333b-4ea0-883e-360137dd4c07\") "
Jul 07 23:20:01.602946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.602791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/999f213b-279f-448b-b6cc-f9dd62a8f18e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-drm2z\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.602946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.602872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/999f213b-279f-448b-b6cc-f9dd62a8f18e-kube-api-access-2vsv9\") pod \"kuadrant-operator-controller-manager-86878c769f-drm2z\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.603777 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.603750    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd51673c-333b-4ea0-883e-360137dd4c07-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bd51673c-333b-4ea0-883e-360137dd4c07" (UID: "bd51673c-333b-4ea0-883e-360137dd4c07"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:20:01.610189 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.610150    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd51673c-333b-4ea0-883e-360137dd4c07-kube-api-access-fg6h4" (OuterVolumeSpecName: "kube-api-access-fg6h4") pod "bd51673c-333b-4ea0-883e-360137dd4c07" (UID: "bd51673c-333b-4ea0-883e-360137dd4c07"). InnerVolumeSpecName "kube-api-access-fg6h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:20:01.703998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.703898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/999f213b-279f-448b-b6cc-f9dd62a8f18e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-drm2z\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.703998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.703992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/999f213b-279f-448b-b6cc-f9dd62a8f18e-kube-api-access-2vsv9\") pod \"kuadrant-operator-controller-manager-86878c769f-drm2z\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.704233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.704079    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg6h4\" (UniqueName: \"kubernetes.io/projected/bd51673c-333b-4ea0-883e-360137dd4c07-kube-api-access-fg6h4\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:20:01.704233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.704095    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd51673c-333b-4ea0-883e-360137dd4c07-extensions-socket-volume\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:20:01.704324 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.704306    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/999f213b-279f-448b-b6cc-f9dd62a8f18e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-drm2z\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.715782 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.715755    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/999f213b-279f-448b-b6cc-f9dd62a8f18e-kube-api-access-2vsv9\") pod \"kuadrant-operator-controller-manager-86878c769f-drm2z\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.825499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.825462    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:01.975522 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:01.975497    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"]
Jul 07 23:20:01.977320 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:20:01.977293    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999f213b_279f_448b_b6cc_f9dd62a8f18e.slice/crio-c59213376c12db5128bd7cbaa8ff4358b946c99b69e7c6f723b605b42540c34d WatchSource:0}: Error finding container c59213376c12db5128bd7cbaa8ff4358b946c99b69e7c6f723b605b42540c34d: Status 404 returned error can't find the container with id c59213376c12db5128bd7cbaa8ff4358b946c99b69e7c6f723b605b42540c34d
Jul 07 23:20:02.214776 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.214746    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd51673c-333b-4ea0-883e-360137dd4c07" containerID="b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f" exitCode=0
Jul 07 23:20:02.215245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.214803    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"
Jul 07 23:20:02.215245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.214837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq" event={"ID":"bd51673c-333b-4ea0-883e-360137dd4c07","Type":"ContainerDied","Data":"b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f"}
Jul 07 23:20:02.215245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.214893    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq" event={"ID":"bd51673c-333b-4ea0-883e-360137dd4c07","Type":"ContainerDied","Data":"d6de6808bdd1c0506fcf85fabb843f84a75fd4ec8d8f38582f0c374040644081"}
Jul 07 23:20:02.215245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.214920    2581 scope.go:117] "RemoveContainer" containerID="b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f"
Jul 07 23:20:02.216710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.216691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z" event={"ID":"999f213b-279f-448b-b6cc-f9dd62a8f18e","Type":"ContainerStarted","Data":"3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2"}
Jul 07 23:20:02.216807 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.216728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z" event={"ID":"999f213b-279f-448b-b6cc-f9dd62a8f18e","Type":"ContainerStarted","Data":"c59213376c12db5128bd7cbaa8ff4358b946c99b69e7c6f723b605b42540c34d"}
Jul 07 23:20:02.216858 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.216828    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:02.224944 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.224927    2581 scope.go:117] "RemoveContainer" containerID="b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f"
Jul 07 23:20:02.225237 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:20:02.225219    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f\": container with ID starting with b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f not found: ID does not exist" containerID="b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f"
Jul 07 23:20:02.225316 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.225247    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f"} err="failed to get container status \"b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f\": rpc error: code = NotFound desc = could not find container \"b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f\": container with ID starting with b59e83a3946c8935ff7ea3bf92a50219ccae20b5364b92dcacecf862e975999f not found: ID does not exist"
Jul 07 23:20:02.243967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.243922    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z" podStartSLOduration=1.24390714 podStartE2EDuration="1.24390714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:02.241621023 +0000 UTC m=+533.461605134" watchObservedRunningTime="2026-07-07 23:20:02.24390714 +0000 UTC m=+533.463891228"
Jul 07 23:20:02.255896 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.255868    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"]
Jul 07 23:20:02.266662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:02.266634    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-86jpq"]
Jul 07 23:20:03.502543 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:03.502508    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd51673c-333b-4ea0-883e-360137dd4c07" path="/var/lib/kubelet/pods/bd51673c-333b-4ea0-883e-360137dd4c07/volumes"
Jul 07 23:20:13.226454 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:13.226425    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:20:13.278333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:13.278300    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"]
Jul 07 23:20:13.278579 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:13.278531    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs" podUID="b621048c-fa6a-445e-adc6-7b6b14224bc1" containerName="manager" containerID="cri-o://5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34" gracePeriod=10
Jul 07 23:20:14.273039 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.273013    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:20:14.289343 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.289303    2581 generic.go:356] "Generic (PLEG): container finished" podID="b621048c-fa6a-445e-adc6-7b6b14224bc1" containerID="5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34" exitCode=0
Jul 07 23:20:14.289343 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.289334    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"
Jul 07 23:20:14.289499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.289384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs" event={"ID":"b621048c-fa6a-445e-adc6-7b6b14224bc1","Type":"ContainerDied","Data":"5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34"}
Jul 07 23:20:14.289499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.289455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs" event={"ID":"b621048c-fa6a-445e-adc6-7b6b14224bc1","Type":"ContainerDied","Data":"c4174a70022294a9369dc65ff5d355fd34b0b837291282f57444120e2120b598"}
Jul 07 23:20:14.289499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.289487    2581 scope.go:117] "RemoveContainer" containerID="5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34"
Jul 07 23:20:14.299899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.299882    2581 scope.go:117] "RemoveContainer" containerID="5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34"
Jul 07 23:20:14.300239 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:20:14.300213    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34\": container with ID starting with 5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34 not found: ID does not exist" containerID="5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34"
Jul 07 23:20:14.300310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.300250    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34"} err="failed to get container status \"5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34\": rpc error: code = NotFound desc = could not find container \"5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34\": container with ID starting with 5ab1fadc19ff3c596228850e6a23be9d778dc0469622a3846253a87e63ddaa34 not found: ID does not exist"
Jul 07 23:20:14.306509 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.306486    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b621048c-fa6a-445e-adc6-7b6b14224bc1-extensions-socket-volume\") pod \"b621048c-fa6a-445e-adc6-7b6b14224bc1\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") "
Jul 07 23:20:14.306592 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.306569    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddr2q\" (UniqueName: \"kubernetes.io/projected/b621048c-fa6a-445e-adc6-7b6b14224bc1-kube-api-access-ddr2q\") pod \"b621048c-fa6a-445e-adc6-7b6b14224bc1\" (UID: \"b621048c-fa6a-445e-adc6-7b6b14224bc1\") "
Jul 07 23:20:14.306837 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.306818    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b621048c-fa6a-445e-adc6-7b6b14224bc1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b621048c-fa6a-445e-adc6-7b6b14224bc1" (UID: "b621048c-fa6a-445e-adc6-7b6b14224bc1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:20:14.308703 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.308676    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b621048c-fa6a-445e-adc6-7b6b14224bc1-kube-api-access-ddr2q" (OuterVolumeSpecName: "kube-api-access-ddr2q") pod "b621048c-fa6a-445e-adc6-7b6b14224bc1" (UID: "b621048c-fa6a-445e-adc6-7b6b14224bc1"). InnerVolumeSpecName "kube-api-access-ddr2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:20:14.407365 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.407313    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b621048c-fa6a-445e-adc6-7b6b14224bc1-extensions-socket-volume\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:20:14.407365 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.407338    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddr2q\" (UniqueName: \"kubernetes.io/projected/b621048c-fa6a-445e-adc6-7b6b14224bc1-kube-api-access-ddr2q\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:20:14.612075 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.612048    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"]
Jul 07 23:20:14.619570 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:14.619544    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qdmxs"]
Jul 07 23:20:15.502626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:15.502596    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b621048c-fa6a-445e-adc6-7b6b14224bc1" path="/var/lib/kubelet/pods/b621048c-fa6a-445e-adc6-7b6b14224bc1/volumes"
Jul 07 23:20:31.274656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.274617    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnvct"]
Jul 07 23:20:31.275058 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.275044    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd51673c-333b-4ea0-883e-360137dd4c07" containerName="manager"
Jul 07 23:20:31.275058 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.275054    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd51673c-333b-4ea0-883e-360137dd4c07" containerName="manager"
Jul 07 23:20:31.275194 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.275063    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b621048c-fa6a-445e-adc6-7b6b14224bc1" containerName="manager"
Jul 07 23:20:31.275194 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.275069    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b621048c-fa6a-445e-adc6-7b6b14224bc1" containerName="manager"
Jul 07 23:20:31.275194 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.275158    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd51673c-333b-4ea0-883e-360137dd4c07" containerName="manager"
Jul 07 23:20:31.275194 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.275167    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b621048c-fa6a-445e-adc6-7b6b14224bc1" containerName="manager"
Jul 07 23:20:31.335929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.335898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnvct"]
Jul 07 23:20:31.336214 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.336049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.339308 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.339282    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 23:20:31.388071 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.388042    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnvct"]
Jul 07 23:20:31.452162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.452128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a24a923-d121-4c4b-9032-ab67bd0f1850-config-file\") pod \"limitador-limitador-64c94fd64f-wnvct\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.452327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.452190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srqlr\" (UniqueName: \"kubernetes.io/projected/8a24a923-d121-4c4b-9032-ab67bd0f1850-kube-api-access-srqlr\") pod \"limitador-limitador-64c94fd64f-wnvct\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.552862 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.552827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srqlr\" (UniqueName: \"kubernetes.io/projected/8a24a923-d121-4c4b-9032-ab67bd0f1850-kube-api-access-srqlr\") pod \"limitador-limitador-64c94fd64f-wnvct\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.553033 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.552943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a24a923-d121-4c4b-9032-ab67bd0f1850-config-file\") pod \"limitador-limitador-64c94fd64f-wnvct\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.553705 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.553686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a24a923-d121-4c4b-9032-ab67bd0f1850-config-file\") pod \"limitador-limitador-64c94fd64f-wnvct\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.561879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.561855    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srqlr\" (UniqueName: \"kubernetes.io/projected/8a24a923-d121-4c4b-9032-ab67bd0f1850-kube-api-access-srqlr\") pod \"limitador-limitador-64c94fd64f-wnvct\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.649750 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.649720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:31.786610 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:31.786577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnvct"]
Jul 07 23:20:31.788387 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:20:31.788361    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a24a923_d121_4c4b_9032_ab67bd0f1850.slice/crio-bfdc68fde5b1697f16fc6b874ecec4af155eefb288120a667ffa1cbc0f898d15 WatchSource:0}: Error finding container bfdc68fde5b1697f16fc6b874ecec4af155eefb288120a667ffa1cbc0f898d15: Status 404 returned error can't find the container with id bfdc68fde5b1697f16fc6b874ecec4af155eefb288120a667ffa1cbc0f898d15
Jul 07 23:20:32.076028 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.075985    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wrqh8"]
Jul 07 23:20:32.081126 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.081090    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrqh8"
Jul 07 23:20:32.084552 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.084034    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9zck9\""
Jul 07 23:20:32.090477 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.090451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrqh8"]
Jul 07 23:20:32.158807 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.158767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mkvk\" (UniqueName: \"kubernetes.io/projected/ddf799c2-6325-4ed5-9174-501db59d8c49-kube-api-access-7mkvk\") pod \"authorino-58cd955675-wrqh8\" (UID: \"ddf799c2-6325-4ed5-9174-501db59d8c49\") " pod="kuadrant-system/authorino-58cd955675-wrqh8"
Jul 07 23:20:32.259509 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.259472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mkvk\" (UniqueName: \"kubernetes.io/projected/ddf799c2-6325-4ed5-9174-501db59d8c49-kube-api-access-7mkvk\") pod \"authorino-58cd955675-wrqh8\" (UID: \"ddf799c2-6325-4ed5-9174-501db59d8c49\") " pod="kuadrant-system/authorino-58cd955675-wrqh8"
Jul 07 23:20:32.269217 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.269190    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mkvk\" (UniqueName: \"kubernetes.io/projected/ddf799c2-6325-4ed5-9174-501db59d8c49-kube-api-access-7mkvk\") pod \"authorino-58cd955675-wrqh8\" (UID: \"ddf799c2-6325-4ed5-9174-501db59d8c49\") " pod="kuadrant-system/authorino-58cd955675-wrqh8"
Jul 07 23:20:32.389794 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.389723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct" event={"ID":"8a24a923-d121-4c4b-9032-ab67bd0f1850","Type":"ContainerStarted","Data":"bfdc68fde5b1697f16fc6b874ecec4af155eefb288120a667ffa1cbc0f898d15"}
Jul 07 23:20:32.395912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.395890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrqh8"
Jul 07 23:20:32.572070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:32.571950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrqh8"]
Jul 07 23:20:33.400148 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:33.400093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrqh8" event={"ID":"ddf799c2-6325-4ed5-9174-501db59d8c49","Type":"ContainerStarted","Data":"a7ae13f0a83a1d7d5f9807b8d49ef48190d58b8d98b98d5e62882d387afdb32e"}
Jul 07 23:20:36.417824 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:36.417798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct" event={"ID":"8a24a923-d121-4c4b-9032-ab67bd0f1850","Type":"ContainerStarted","Data":"8e84776f3e39463fbde8aace3a9351b6f993c2b118bc2c63f16e66a15df55fcf"}
Jul 07 23:20:36.418158 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:36.418044    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:36.435019 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:36.434945    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct" podStartSLOduration=0.925260964 podStartE2EDuration="5.434922356s" totalImagesPullingTime="4.509661392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:36.434339835 +0000 UTC m=+567.654323947" watchObservedRunningTime="2026-07-07 23:20:36.434922356 +0000 UTC m=+567.654906446"
Jul 07 23:20:36.626692 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:36.626612    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrqh8"]
Jul 07 23:20:37.433010 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:37.432968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrqh8" event={"ID":"ddf799c2-6325-4ed5-9174-501db59d8c49","Type":"ContainerStarted","Data":"1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99"}
Jul 07 23:20:37.449174 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:37.449132    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wrqh8" podStartSLOduration=1.664998382 podStartE2EDuration="5.449117225s" totalImagesPullingTime="3.784118843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:37.44735715 +0000 UTC m=+568.667341241" watchObservedRunningTime="2026-07-07 23:20:37.449117225 +0000 UTC m=+568.669101316"
Jul 07 23:20:38.439422 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:38.439380    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wrqh8" podUID="ddf799c2-6325-4ed5-9174-501db59d8c49" containerName="authorino" containerID="cri-o://1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99" gracePeriod=30
Jul 07 23:20:38.694587 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:38.694515    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrqh8"
Jul 07 23:20:38.820214 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:38.820177    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mkvk\" (UniqueName: \"kubernetes.io/projected/ddf799c2-6325-4ed5-9174-501db59d8c49-kube-api-access-7mkvk\") pod \"ddf799c2-6325-4ed5-9174-501db59d8c49\" (UID: \"ddf799c2-6325-4ed5-9174-501db59d8c49\") "
Jul 07 23:20:38.822241 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:38.822211    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf799c2-6325-4ed5-9174-501db59d8c49-kube-api-access-7mkvk" (OuterVolumeSpecName: "kube-api-access-7mkvk") pod "ddf799c2-6325-4ed5-9174-501db59d8c49" (UID: "ddf799c2-6325-4ed5-9174-501db59d8c49"). InnerVolumeSpecName "kube-api-access-7mkvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:20:38.921284 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:38.921253    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mkvk\" (UniqueName: \"kubernetes.io/projected/ddf799c2-6325-4ed5-9174-501db59d8c49-kube-api-access-7mkvk\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:20:39.445836 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.445803    2581 generic.go:356] "Generic (PLEG): container finished" podID="ddf799c2-6325-4ed5-9174-501db59d8c49" containerID="1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99" exitCode=0
Jul 07 23:20:39.446262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.445841    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrqh8"
Jul 07 23:20:39.446262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.445878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrqh8" event={"ID":"ddf799c2-6325-4ed5-9174-501db59d8c49","Type":"ContainerDied","Data":"1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99"}
Jul 07 23:20:39.446262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.445914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrqh8" event={"ID":"ddf799c2-6325-4ed5-9174-501db59d8c49","Type":"ContainerDied","Data":"a7ae13f0a83a1d7d5f9807b8d49ef48190d58b8d98b98d5e62882d387afdb32e"}
Jul 07 23:20:39.446262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.445932    2581 scope.go:117] "RemoveContainer" containerID="1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99"
Jul 07 23:20:39.455083 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.455063    2581 scope.go:117] "RemoveContainer" containerID="1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99"
Jul 07 23:20:39.455392 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:20:39.455372    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99\": container with ID starting with 1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99 not found: ID does not exist" containerID="1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99"
Jul 07 23:20:39.455461 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.455404    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99"} err="failed to get container status \"1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99\": rpc error: code = NotFound desc = could not find container \"1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99\": container with ID starting with 1787f0940db25bf027e101fa1324e7449123a36342712444854eb1cc36ee2d99 not found: ID does not exist"
Jul 07 23:20:39.467185 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.467161    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrqh8"]
Jul 07 23:20:39.470845 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.470824    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrqh8"]
Jul 07 23:20:39.502443 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:39.502416    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf799c2-6325-4ed5-9174-501db59d8c49" path="/var/lib/kubelet/pods/ddf799c2-6325-4ed5-9174-501db59d8c49/volumes"
Jul 07 23:20:46.006430 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:46.006387    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnvct"]
Jul 07 23:20:46.007029 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:46.006648    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct" podUID="8a24a923-d121-4c4b-9032-ab67bd0f1850" containerName="limitador" containerID="cri-o://8e84776f3e39463fbde8aace3a9351b6f993c2b118bc2c63f16e66a15df55fcf" gracePeriod=30
Jul 07 23:20:46.007449 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:46.007419    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:46.486060 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:46.486027    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a24a923-d121-4c4b-9032-ab67bd0f1850" containerID="8e84776f3e39463fbde8aace3a9351b6f993c2b118bc2c63f16e66a15df55fcf" exitCode=0
Jul 07 23:20:46.486242 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:46.486112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct" event={"ID":"8a24a923-d121-4c4b-9032-ab67bd0f1850","Type":"ContainerDied","Data":"8e84776f3e39463fbde8aace3a9351b6f993c2b118bc2c63f16e66a15df55fcf"}
Jul 07 23:20:46.960518 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:46.960497    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:47.093010 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.092926    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a24a923-d121-4c4b-9032-ab67bd0f1850-config-file\") pod \"8a24a923-d121-4c4b-9032-ab67bd0f1850\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") "
Jul 07 23:20:47.093010 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.092974    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srqlr\" (UniqueName: \"kubernetes.io/projected/8a24a923-d121-4c4b-9032-ab67bd0f1850-kube-api-access-srqlr\") pod \"8a24a923-d121-4c4b-9032-ab67bd0f1850\" (UID: \"8a24a923-d121-4c4b-9032-ab67bd0f1850\") "
Jul 07 23:20:47.093428 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.093304    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a24a923-d121-4c4b-9032-ab67bd0f1850-config-file" (OuterVolumeSpecName: "config-file") pod "8a24a923-d121-4c4b-9032-ab67bd0f1850" (UID: "8a24a923-d121-4c4b-9032-ab67bd0f1850"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:20:47.095075 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.095042    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a24a923-d121-4c4b-9032-ab67bd0f1850-kube-api-access-srqlr" (OuterVolumeSpecName: "kube-api-access-srqlr") pod "8a24a923-d121-4c4b-9032-ab67bd0f1850" (UID: "8a24a923-d121-4c4b-9032-ab67bd0f1850"). InnerVolumeSpecName "kube-api-access-srqlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:20:47.194510 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.194483    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a24a923-d121-4c4b-9032-ab67bd0f1850-config-file\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:20:47.194510 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.194508    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srqlr\" (UniqueName: \"kubernetes.io/projected/8a24a923-d121-4c4b-9032-ab67bd0f1850-kube-api-access-srqlr\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:20:47.493418 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.493334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct" event={"ID":"8a24a923-d121-4c4b-9032-ab67bd0f1850","Type":"ContainerDied","Data":"bfdc68fde5b1697f16fc6b874ecec4af155eefb288120a667ffa1cbc0f898d15"}
Jul 07 23:20:47.493418 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.493366    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnvct"
Jul 07 23:20:47.493418 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.493397    2581 scope.go:117] "RemoveContainer" containerID="8e84776f3e39463fbde8aace3a9351b6f993c2b118bc2c63f16e66a15df55fcf"
Jul 07 23:20:47.523983 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.523961    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnvct"]
Jul 07 23:20:47.532251 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:47.532231    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnvct"]
Jul 07 23:20:49.502994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:49.502962    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a24a923-d121-4c4b-9032-ab67bd0f1850" path="/var/lib/kubelet/pods/8a24a923-d121-4c4b-9032-ab67bd0f1850/volumes"
Jul 07 23:20:51.551115 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.551073    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"]
Jul 07 23:20:51.551723 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.551701    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a24a923-d121-4c4b-9032-ab67bd0f1850" containerName="limitador"
Jul 07 23:20:51.551768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.551728    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a24a923-d121-4c4b-9032-ab67bd0f1850" containerName="limitador"
Jul 07 23:20:51.551768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.551743    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf799c2-6325-4ed5-9174-501db59d8c49" containerName="authorino"
Jul 07 23:20:51.551768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.551753    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf799c2-6325-4ed5-9174-501db59d8c49" containerName="authorino"
Jul 07 23:20:51.551913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.551899    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a24a923-d121-4c4b-9032-ab67bd0f1850" containerName="limitador"
Jul 07 23:20:51.551950 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.551918    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf799c2-6325-4ed5-9174-501db59d8c49" containerName="authorino"
Jul 07 23:20:51.556655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.556635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:51.560732 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.560709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 07 23:20:51.560732 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.560729    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 07 23:20:51.560901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.560709    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f6plj\""
Jul 07 23:20:51.560901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.560709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 07 23:20:51.562846 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.562820    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"]
Jul 07 23:20:51.733680 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.733647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a370-252b-4dfe-aabc-ce7e83a077dc-data\") pod \"postgres-69fb4594cf-qjxjt\" (UID: \"f9e2a370-252b-4dfe-aabc-ce7e83a077dc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:51.733854 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.733693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzn44\" (UniqueName: \"kubernetes.io/projected/f9e2a370-252b-4dfe-aabc-ce7e83a077dc-kube-api-access-vzn44\") pod \"postgres-69fb4594cf-qjxjt\" (UID: \"f9e2a370-252b-4dfe-aabc-ce7e83a077dc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:51.834513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.834428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a370-252b-4dfe-aabc-ce7e83a077dc-data\") pod \"postgres-69fb4594cf-qjxjt\" (UID: \"f9e2a370-252b-4dfe-aabc-ce7e83a077dc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:51.834513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.834488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzn44\" (UniqueName: \"kubernetes.io/projected/f9e2a370-252b-4dfe-aabc-ce7e83a077dc-kube-api-access-vzn44\") pod \"postgres-69fb4594cf-qjxjt\" (UID: \"f9e2a370-252b-4dfe-aabc-ce7e83a077dc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:51.834834 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.834815    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a370-252b-4dfe-aabc-ce7e83a077dc-data\") pod \"postgres-69fb4594cf-qjxjt\" (UID: \"f9e2a370-252b-4dfe-aabc-ce7e83a077dc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:51.846217 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.846191    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzn44\" (UniqueName: \"kubernetes.io/projected/f9e2a370-252b-4dfe-aabc-ce7e83a077dc-kube-api-access-vzn44\") pod \"postgres-69fb4594cf-qjxjt\" (UID: \"f9e2a370-252b-4dfe-aabc-ce7e83a077dc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:51.869989 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:51.869967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:52.026625 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:52.026597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"]
Jul 07 23:20:52.027720 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:20:52.027690    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e2a370_252b_4dfe_aabc_ce7e83a077dc.slice/crio-29b314fdb86afccc5c4b3557de02bffb8d8b8fe1bd68eb3113983e18c0efd222 WatchSource:0}: Error finding container 29b314fdb86afccc5c4b3557de02bffb8d8b8fe1bd68eb3113983e18c0efd222: Status 404 returned error can't find the container with id 29b314fdb86afccc5c4b3557de02bffb8d8b8fe1bd68eb3113983e18c0efd222
Jul 07 23:20:52.524061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:52.524028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt" event={"ID":"f9e2a370-252b-4dfe-aabc-ce7e83a077dc","Type":"ContainerStarted","Data":"29b314fdb86afccc5c4b3557de02bffb8d8b8fe1bd68eb3113983e18c0efd222"}
Jul 07 23:20:57.556702 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:57.556648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt" event={"ID":"f9e2a370-252b-4dfe-aabc-ce7e83a077dc","Type":"ContainerStarted","Data":"92a1d75559ab01a0637d2fd7cf73145763dfec4e2e8c08107a2d400535138ce8"}
Jul 07 23:20:57.557090 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:57.556740    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:20:57.574805 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:20:57.574758    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt" podStartSLOduration=1.927165883 podStartE2EDuration="6.574745052s" totalImagesPullingTime="4.647579169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:57.573322552 +0000 UTC m=+588.793306640" watchObservedRunningTime="2026-07-07 23:20:57.574745052 +0000 UTC m=+588.794729142"
Jul 07 23:21:03.592479 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:03.592451    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qjxjt"
Jul 07 23:21:04.162676 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.162641    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5bq9"]
Jul 07 23:21:04.179965 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.179938    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5bq9"]
Jul 07 23:21:04.180148 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.180029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5bq9"
Jul 07 23:21:04.182725 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.182700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9zck9\""
Jul 07 23:21:04.251838 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.251801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw9np\" (UniqueName: \"kubernetes.io/projected/aeb0e171-98ad-4dd7-83c3-dd22421e3f44-kube-api-access-dw9np\") pod \"authorino-5d4b67c446-x5bq9\" (UID: \"aeb0e171-98ad-4dd7-83c3-dd22421e3f44\") " pod="kuadrant-system/authorino-5d4b67c446-x5bq9"
Jul 07 23:21:04.352424 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.352391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw9np\" (UniqueName: \"kubernetes.io/projected/aeb0e171-98ad-4dd7-83c3-dd22421e3f44-kube-api-access-dw9np\") pod \"authorino-5d4b67c446-x5bq9\" (UID: \"aeb0e171-98ad-4dd7-83c3-dd22421e3f44\") " pod="kuadrant-system/authorino-5d4b67c446-x5bq9"
Jul 07 23:21:04.360405 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.360379    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw9np\" (UniqueName: \"kubernetes.io/projected/aeb0e171-98ad-4dd7-83c3-dd22421e3f44-kube-api-access-dw9np\") pod \"authorino-5d4b67c446-x5bq9\" (UID: \"aeb0e171-98ad-4dd7-83c3-dd22421e3f44\") " pod="kuadrant-system/authorino-5d4b67c446-x5bq9"
Jul 07 23:21:04.397866 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.397838    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5bq9"]
Jul 07 23:21:04.398159 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.398142    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5bq9"
Jul 07 23:21:04.421575 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.421504    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f85969f-nxwzq"]
Jul 07 23:21:04.448023 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.447972    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f85969f-nxwzq"]
Jul 07 23:21:04.448166 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.448119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f85969f-nxwzq"
Jul 07 23:21:04.554127 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.554083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8bc\" (UniqueName: \"kubernetes.io/projected/c87a82e0-e2ff-4cfc-8c64-af33a6ae4741-kube-api-access-gb8bc\") pod \"authorino-7f85969f-nxwzq\" (UID: \"c87a82e0-e2ff-4cfc-8c64-af33a6ae4741\") " pod="kuadrant-system/authorino-7f85969f-nxwzq"
Jul 07 23:21:04.574398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.574367    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5bq9"]
Jul 07 23:21:04.575688 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:21:04.575664    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeb0e171_98ad_4dd7_83c3_dd22421e3f44.slice/crio-08e6ac9d444421aa53fd27e639f019c52165e99dba10b6dc88978fa48ba5806e WatchSource:0}: Error finding container 08e6ac9d444421aa53fd27e639f019c52165e99dba10b6dc88978fa48ba5806e: Status 404 returned error can't find the container with id 08e6ac9d444421aa53fd27e639f019c52165e99dba10b6dc88978fa48ba5806e
Jul 07 23:21:04.594723 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.594691    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f85969f-nxwzq"]
Jul 07 23:21:04.595089 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:04.594955    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gb8bc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7f85969f-nxwzq" podUID="c87a82e0-e2ff-4cfc-8c64-af33a6ae4741"
Jul 07 23:21:04.598239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.598214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5bq9" event={"ID":"aeb0e171-98ad-4dd7-83c3-dd22421e3f44","Type":"ContainerStarted","Data":"08e6ac9d444421aa53fd27e639f019c52165e99dba10b6dc88978fa48ba5806e"}
Jul 07 23:21:04.620260 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.620232    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75f998d847-m9rz2"]
Jul 07 23:21:04.647525 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.647498    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75f998d847-m9rz2"]
Jul 07 23:21:04.647660 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.647582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:04.650032 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.650004    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 23:21:04.654742 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.654716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8bc\" (UniqueName: \"kubernetes.io/projected/c87a82e0-e2ff-4cfc-8c64-af33a6ae4741-kube-api-access-gb8bc\") pod \"authorino-7f85969f-nxwzq\" (UID: \"c87a82e0-e2ff-4cfc-8c64-af33a6ae4741\") " pod="kuadrant-system/authorino-7f85969f-nxwzq"
Jul 07 23:21:04.665237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.665216    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8bc\" (UniqueName: \"kubernetes.io/projected/c87a82e0-e2ff-4cfc-8c64-af33a6ae4741-kube-api-access-gb8bc\") pod \"authorino-7f85969f-nxwzq\" (UID: \"c87a82e0-e2ff-4cfc-8c64-af33a6ae4741\") " pod="kuadrant-system/authorino-7f85969f-nxwzq"
Jul 07 23:21:04.755489 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.755430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gr9k\" (UniqueName: \"kubernetes.io/projected/5f8c4034-62fd-4c56-94d4-301904c3c8f1-kube-api-access-2gr9k\") pod \"authorino-75f998d847-m9rz2\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") " pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:04.755598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.755532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f8c4034-62fd-4c56-94d4-301904c3c8f1-tls-cert\") pod \"authorino-75f998d847-m9rz2\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") " pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:04.856391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.856355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f8c4034-62fd-4c56-94d4-301904c3c8f1-tls-cert\") pod \"authorino-75f998d847-m9rz2\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") " pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:04.856548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.856409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gr9k\" (UniqueName: \"kubernetes.io/projected/5f8c4034-62fd-4c56-94d4-301904c3c8f1-kube-api-access-2gr9k\") pod \"authorino-75f998d847-m9rz2\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") " pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:04.858798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.858769    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f8c4034-62fd-4c56-94d4-301904c3c8f1-tls-cert\") pod \"authorino-75f998d847-m9rz2\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") " pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:04.864547 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.864524    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gr9k\" (UniqueName: \"kubernetes.io/projected/5f8c4034-62fd-4c56-94d4-301904c3c8f1-kube-api-access-2gr9k\") pod \"authorino-75f998d847-m9rz2\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") " pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:04.957120 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:04.957064    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:21:05.105978 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.105948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75f998d847-m9rz2"]
Jul 07 23:21:05.120999 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:21:05.120970    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f8c4034_62fd_4c56_94d4_301904c3c8f1.slice/crio-0114d31a4669a72527fa2698bf476b74796ccfb185a17e148f4440cc646353da WatchSource:0}: Error finding container 0114d31a4669a72527fa2698bf476b74796ccfb185a17e148f4440cc646353da: Status 404 returned error can't find the container with id 0114d31a4669a72527fa2698bf476b74796ccfb185a17e148f4440cc646353da
Jul 07 23:21:05.611966 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.611896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5bq9" event={"ID":"aeb0e171-98ad-4dd7-83c3-dd22421e3f44","Type":"ContainerStarted","Data":"3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439"}
Jul 07 23:21:05.611966 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.611934    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-x5bq9" podUID="aeb0e171-98ad-4dd7-83c3-dd22421e3f44" containerName="authorino" containerID="cri-o://3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439" gracePeriod=30
Jul 07 23:21:05.613584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.613548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f998d847-m9rz2" event={"ID":"5f8c4034-62fd-4c56-94d4-301904c3c8f1","Type":"ContainerStarted","Data":"0114d31a4669a72527fa2698bf476b74796ccfb185a17e148f4440cc646353da"}
Jul 07 23:21:05.613764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.613735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f85969f-nxwzq"
Jul 07 23:21:05.628010 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.627973    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-x5bq9" podStartSLOduration=1.0577640719999999 podStartE2EDuration="1.627959156s" totalImagesPullingTime="570.195084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:21:05.627038291 +0000 UTC m=+596.847022381" watchObservedRunningTime="2026-07-07 23:21:05.627959156 +0000 UTC m=+596.847943242"
Jul 07 23:21:05.633759 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.633670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f85969f-nxwzq"
Jul 07 23:21:05.663229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.663198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb8bc\" (UniqueName: \"kubernetes.io/projected/c87a82e0-e2ff-4cfc-8c64-af33a6ae4741-kube-api-access-gb8bc\") pod \"c87a82e0-e2ff-4cfc-8c64-af33a6ae4741\" (UID: \"c87a82e0-e2ff-4cfc-8c64-af33a6ae4741\") "
Jul 07 23:21:05.665223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.665197    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c87a82e0-e2ff-4cfc-8c64-af33a6ae4741-kube-api-access-gb8bc" (OuterVolumeSpecName: "kube-api-access-gb8bc") pod "c87a82e0-e2ff-4cfc-8c64-af33a6ae4741" (UID: "c87a82e0-e2ff-4cfc-8c64-af33a6ae4741"). InnerVolumeSpecName "kube-api-access-gb8bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:21:05.764200 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.764164    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb8bc\" (UniqueName: \"kubernetes.io/projected/c87a82e0-e2ff-4cfc-8c64-af33a6ae4741-kube-api-access-gb8bc\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:21:05.910539 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.910506    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5bq9"
Jul 07 23:21:05.966058 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.966028    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw9np\" (UniqueName: \"kubernetes.io/projected/aeb0e171-98ad-4dd7-83c3-dd22421e3f44-kube-api-access-dw9np\") pod \"aeb0e171-98ad-4dd7-83c3-dd22421e3f44\" (UID: \"aeb0e171-98ad-4dd7-83c3-dd22421e3f44\") "
Jul 07 23:21:05.967993 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:05.967970    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb0e171-98ad-4dd7-83c3-dd22421e3f44-kube-api-access-dw9np" (OuterVolumeSpecName: "kube-api-access-dw9np") pod "aeb0e171-98ad-4dd7-83c3-dd22421e3f44" (UID: "aeb0e171-98ad-4dd7-83c3-dd22421e3f44"). InnerVolumeSpecName "kube-api-access-dw9np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:21:06.067412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.067375    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw9np\" (UniqueName: \"kubernetes.io/projected/aeb0e171-98ad-4dd7-83c3-dd22421e3f44-kube-api-access-dw9np\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:21:06.620994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.620905    2581 generic.go:356] "Generic (PLEG): container finished" podID="aeb0e171-98ad-4dd7-83c3-dd22421e3f44" containerID="3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439" exitCode=0
Jul 07 23:21:06.620994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.620940    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5bq9"
Jul 07 23:21:06.620994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.620984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5bq9" event={"ID":"aeb0e171-98ad-4dd7-83c3-dd22421e3f44","Type":"ContainerDied","Data":"3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439"}
Jul 07 23:21:06.621566 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.621025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5bq9" event={"ID":"aeb0e171-98ad-4dd7-83c3-dd22421e3f44","Type":"ContainerDied","Data":"08e6ac9d444421aa53fd27e639f019c52165e99dba10b6dc88978fa48ba5806e"}
Jul 07 23:21:06.621566 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.621046    2581 scope.go:117] "RemoveContainer" containerID="3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439"
Jul 07 23:21:06.622670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.622653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f85969f-nxwzq"
Jul 07 23:21:06.622670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.622656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f998d847-m9rz2" event={"ID":"5f8c4034-62fd-4c56-94d4-301904c3c8f1","Type":"ContainerStarted","Data":"e7ea19d9ec2d85c33b539fd504cd2c90d16fa3794c19e4bcb388c5cb75ac946a"}
Jul 07 23:21:06.630836 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.630820    2581 scope.go:117] "RemoveContainer" containerID="3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439"
Jul 07 23:21:06.631159 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:06.631130    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439\": container with ID starting with 3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439 not found: ID does not exist" containerID="3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439"
Jul 07 23:21:06.631271 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.631185    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439"} err="failed to get container status \"3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439\": rpc error: code = NotFound desc = could not find container \"3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439\": container with ID starting with 3fb89913817f8ab50944d09659ef800455f86c6df2729b3ad7a6dcad188f6439 not found: ID does not exist"
Jul 07 23:21:06.641089 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.641043    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75f998d847-m9rz2" podStartSLOduration=2.049618579 podStartE2EDuration="2.641031275s" totalImagesPullingTime="591.412696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:21:06.638799267 +0000 UTC m=+597.858783356" watchObservedRunningTime="2026-07-07 23:21:06.641031275 +0000 UTC m=+597.861015364"
Jul 07 23:21:06.661737 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.661709    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5bq9"]
Jul 07 23:21:06.665688 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.665664    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5bq9"]
Jul 07 23:21:06.694793 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.694761    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f85969f-nxwzq"]
Jul 07 23:21:06.700191 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:06.700167    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f85969f-nxwzq"]
Jul 07 23:21:07.503268 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:07.503235    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeb0e171-98ad-4dd7-83c3-dd22421e3f44" path="/var/lib/kubelet/pods/aeb0e171-98ad-4dd7-83c3-dd22421e3f44/volumes"
Jul 07 23:21:07.503577 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:07.503565    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c87a82e0-e2ff-4cfc-8c64-af33a6ae4741" path="/var/lib/kubelet/pods/c87a82e0-e2ff-4cfc-8c64-af33a6ae4741/volumes"
Jul 07 23:21:11.290858 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.290755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:21:11.307658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.292014    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:21:11.486172 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.486130    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bf4887c8b-cwlvk"]
Jul 07 23:21:11.486544 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.486532    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb0e171-98ad-4dd7-83c3-dd22421e3f44" containerName="authorino"
Jul 07 23:21:11.486605 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.486546    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb0e171-98ad-4dd7-83c3-dd22421e3f44" containerName="authorino"
Jul 07 23:21:11.486643 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.486620    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb0e171-98ad-4dd7-83c3-dd22421e3f44" containerName="authorino"
Jul 07 23:21:11.488663 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.488648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:11.491327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.491299    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 23:21:11.491455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.491384    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 23:21:11.492530 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.492486    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ng6c5\""
Jul 07 23:21:11.503889 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.503864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bf4887c8b-cwlvk"]
Jul 07 23:21:11.616297 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.616262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert\") pod \"maas-controller-bf4887c8b-cwlvk\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") " pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:11.616297 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.616297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfbk\" (UniqueName: \"kubernetes.io/projected/37af6f82-478c-4fd5-841c-76abac524acd-kube-api-access-tpfbk\") pod \"maas-controller-bf4887c8b-cwlvk\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") " pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:11.689274 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.689242    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54d6fc6777-nwwnj"]
Jul 07 23:21:11.691795 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.691781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:11.701561 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.701536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54d6fc6777-nwwnj"]
Jul 07 23:21:11.717030 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.717004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert\") pod \"maas-controller-bf4887c8b-cwlvk\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") " pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:11.717030 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.717033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfbk\" (UniqueName: \"kubernetes.io/projected/37af6f82-478c-4fd5-841c-76abac524acd-kube-api-access-tpfbk\") pod \"maas-controller-bf4887c8b-cwlvk\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") " pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:11.717232 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:11.717179    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 23:21:11.717275 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:11.717266    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert podName:37af6f82-478c-4fd5-841c-76abac524acd nodeName:}" failed. No retries permitted until 2026-07-07 23:21:12.217244843 +0000 UTC m=+603.437228925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert") pod "maas-controller-bf4887c8b-cwlvk" (UID: "37af6f82-478c-4fd5-841c-76abac524acd") : secret "maas-controller-webhook-cert" not found
Jul 07 23:21:11.726656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.726634    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfbk\" (UniqueName: \"kubernetes.io/projected/37af6f82-478c-4fd5-841c-76abac524acd-kube-api-access-tpfbk\") pod \"maas-controller-bf4887c8b-cwlvk\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") " pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:11.818133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.818074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert\") pod \"maas-controller-54d6fc6777-nwwnj\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") " pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:11.818133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.818136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpxq\" (UniqueName: \"kubernetes.io/projected/b6af453a-dfdb-4f49-824a-193a03896eca-kube-api-access-7gpxq\") pod \"maas-controller-54d6fc6777-nwwnj\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") " pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:11.919427 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.919337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert\") pod \"maas-controller-54d6fc6777-nwwnj\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") " pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:11.919427 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.919375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpxq\" (UniqueName: \"kubernetes.io/projected/b6af453a-dfdb-4f49-824a-193a03896eca-kube-api-access-7gpxq\") pod \"maas-controller-54d6fc6777-nwwnj\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") " pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:11.919636 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:11.919482    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 23:21:11.919636 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:11.919555    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert podName:b6af453a-dfdb-4f49-824a-193a03896eca nodeName:}" failed. No retries permitted until 2026-07-07 23:21:12.419538781 +0000 UTC m=+603.639522862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert") pod "maas-controller-54d6fc6777-nwwnj" (UID: "b6af453a-dfdb-4f49-824a-193a03896eca") : secret "maas-controller-webhook-cert" not found
Jul 07 23:21:11.929006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:11.928978    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpxq\" (UniqueName: \"kubernetes.io/projected/b6af453a-dfdb-4f49-824a-193a03896eca-kube-api-access-7gpxq\") pod \"maas-controller-54d6fc6777-nwwnj\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") " pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:12.222518 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.222430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert\") pod \"maas-controller-bf4887c8b-cwlvk\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") " pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:12.224723 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.224692    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert\") pod \"maas-controller-bf4887c8b-cwlvk\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") " pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:12.398899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.398866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:12.424756 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.424728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert\") pod \"maas-controller-54d6fc6777-nwwnj\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") " pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:12.427012 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.426989    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert\") pod \"maas-controller-54d6fc6777-nwwnj\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") " pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:12.533626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.533602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bf4887c8b-cwlvk"]
Jul 07 23:21:12.535377 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:21:12.535350    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37af6f82_478c_4fd5_841c_76abac524acd.slice/crio-ef9324ddda42f6d494a179e3b3cc7b8c22db04622ca52c14d20c752aea7c1ca4 WatchSource:0}: Error finding container ef9324ddda42f6d494a179e3b3cc7b8c22db04622ca52c14d20c752aea7c1ca4: Status 404 returned error can't find the container with id ef9324ddda42f6d494a179e3b3cc7b8c22db04622ca52c14d20c752aea7c1ca4
Jul 07 23:21:12.602513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.602487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:12.661499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.661416    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf4887c8b-cwlvk" event={"ID":"37af6f82-478c-4fd5-841c-76abac524acd","Type":"ContainerStarted","Data":"ef9324ddda42f6d494a179e3b3cc7b8c22db04622ca52c14d20c752aea7c1ca4"}
Jul 07 23:21:12.734598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:12.734577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54d6fc6777-nwwnj"]
Jul 07 23:21:12.737073 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:21:12.737047    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6af453a_dfdb_4f49_824a_193a03896eca.slice/crio-0b7c90347ac2fe9908683a912b990afb46e72c35bf9a04c04bc6ea9a380c8b15 WatchSource:0}: Error finding container 0b7c90347ac2fe9908683a912b990afb46e72c35bf9a04c04bc6ea9a380c8b15: Status 404 returned error can't find the container with id 0b7c90347ac2fe9908683a912b990afb46e72c35bf9a04c04bc6ea9a380c8b15
Jul 07 23:21:13.673987 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:13.673944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d6fc6777-nwwnj" event={"ID":"b6af453a-dfdb-4f49-824a-193a03896eca","Type":"ContainerStarted","Data":"0b7c90347ac2fe9908683a912b990afb46e72c35bf9a04c04bc6ea9a380c8b15"}
Jul 07 23:21:15.688488 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:15.688451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf4887c8b-cwlvk" event={"ID":"37af6f82-478c-4fd5-841c-76abac524acd","Type":"ContainerStarted","Data":"a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592"}
Jul 07 23:21:15.688948 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:15.688504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:15.689928 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:15.689904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d6fc6777-nwwnj" event={"ID":"b6af453a-dfdb-4f49-824a-193a03896eca","Type":"ContainerStarted","Data":"6c7cb9d4f56acc67fac3f466587cab90fea8eb5b47ebe4ef9c756ba0802d1797"}
Jul 07 23:21:15.690002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:15.689947    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:15.710138 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:15.710083    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bf4887c8b-cwlvk" podStartSLOduration=2.458994372 podStartE2EDuration="4.710069643s" totalImagesPullingTime="2.251075271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:21:15.708195281 +0000 UTC m=+606.928179369" watchObservedRunningTime="2026-07-07 23:21:15.710069643 +0000 UTC m=+606.930053732"
Jul 07 23:21:15.731857 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:15.731819    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54d6fc6777-nwwnj" podStartSLOduration=2.672266457 podStartE2EDuration="4.731806297s" totalImagesPullingTime="2.05953984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:21:15.731447138 +0000 UTC m=+606.951431238" watchObservedRunningTime="2026-07-07 23:21:15.731806297 +0000 UTC m=+606.951790379"
Jul 07 23:21:26.700085 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:26.700051    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:26.700455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:26.700313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:21:26.756595 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:26.756561    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bf4887c8b-cwlvk"]
Jul 07 23:21:26.756830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:26.756800    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-bf4887c8b-cwlvk" podUID="37af6f82-478c-4fd5-841c-76abac524acd" containerName="manager" containerID="cri-o://a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592" gracePeriod=30
Jul 07 23:21:27.007494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.007471    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:27.162709 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.162670    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert\") pod \"37af6f82-478c-4fd5-841c-76abac524acd\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") "
Jul 07 23:21:27.162902 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.162781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpfbk\" (UniqueName: \"kubernetes.io/projected/37af6f82-478c-4fd5-841c-76abac524acd-kube-api-access-tpfbk\") pod \"37af6f82-478c-4fd5-841c-76abac524acd\" (UID: \"37af6f82-478c-4fd5-841c-76abac524acd\") "
Jul 07 23:21:27.164808 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.164783    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "37af6f82-478c-4fd5-841c-76abac524acd" (UID: "37af6f82-478c-4fd5-841c-76abac524acd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:21:27.164908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.164896    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37af6f82-478c-4fd5-841c-76abac524acd-kube-api-access-tpfbk" (OuterVolumeSpecName: "kube-api-access-tpfbk") pod "37af6f82-478c-4fd5-841c-76abac524acd" (UID: "37af6f82-478c-4fd5-841c-76abac524acd"). InnerVolumeSpecName "kube-api-access-tpfbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:21:27.264548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.264469    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpfbk\" (UniqueName: \"kubernetes.io/projected/37af6f82-478c-4fd5-841c-76abac524acd-kube-api-access-tpfbk\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:21:27.264548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.264497    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37af6f82-478c-4fd5-841c-76abac524acd-webhook-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:21:27.757054 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.757024    2581 generic.go:356] "Generic (PLEG): container finished" podID="37af6f82-478c-4fd5-841c-76abac524acd" containerID="a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592" exitCode=0
Jul 07 23:21:27.757435 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.757065    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf4887c8b-cwlvk"
Jul 07 23:21:27.757435 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.757123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf4887c8b-cwlvk" event={"ID":"37af6f82-478c-4fd5-841c-76abac524acd","Type":"ContainerDied","Data":"a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592"}
Jul 07 23:21:27.757435 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.757172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf4887c8b-cwlvk" event={"ID":"37af6f82-478c-4fd5-841c-76abac524acd","Type":"ContainerDied","Data":"ef9324ddda42f6d494a179e3b3cc7b8c22db04622ca52c14d20c752aea7c1ca4"}
Jul 07 23:21:27.757435 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.757196    2581 scope.go:117] "RemoveContainer" containerID="a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592"
Jul 07 23:21:27.765856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.765836    2581 scope.go:117] "RemoveContainer" containerID="a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592"
Jul 07 23:21:27.766137 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:27.766094    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592\": container with ID starting with a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592 not found: ID does not exist" containerID="a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592"
Jul 07 23:21:27.766223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.766143    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592"} err="failed to get container status \"a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592\": rpc error: code = NotFound desc = could not find container \"a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592\": container with ID starting with a5de7786dc757c49e7c8d17c552a46cfda5ad336781bdf8704f1bcb315ba0592 not found: ID does not exist"
Jul 07 23:21:27.778170 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.778144    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bf4887c8b-cwlvk"]
Jul 07 23:21:27.783794 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:27.783772    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bf4887c8b-cwlvk"]
Jul 07 23:21:29.504236 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:29.504206    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37af6f82-478c-4fd5-841c-76abac524acd" path="/var/lib/kubelet/pods/37af6f82-478c-4fd5-841c-76abac524acd/volumes"
Jul 07 23:21:48.197124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.197004    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"]
Jul 07 23:21:48.197933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.197657    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37af6f82-478c-4fd5-841c-76abac524acd" containerName="manager"
Jul 07 23:21:48.197933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.197678    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37af6f82-478c-4fd5-841c-76abac524acd" containerName="manager"
Jul 07 23:21:48.197933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.197790    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37af6f82-478c-4fd5-841c-76abac524acd" containerName="manager"
Jul 07 23:21:48.203871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.203848    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.210177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.210153    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 07 23:21:48.210318 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.210194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fk929\""
Jul 07 23:21:48.223960 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.223924    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"]
Jul 07 23:21:48.239472 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.239442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51652710-debf-4da7-a75e-6883aca0991d-openshift-service-ca\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.239574 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.239475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hc94\" (UniqueName: \"kubernetes.io/projected/51652710-debf-4da7-a75e-6883aca0991d-kube-api-access-7hc94\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.239647 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.239623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51652710-debf-4da7-a75e-6883aca0991d-maas-api-tls\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.340288 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.340252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51652710-debf-4da7-a75e-6883aca0991d-openshift-service-ca\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.340288 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.340288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hc94\" (UniqueName: \"kubernetes.io/projected/51652710-debf-4da7-a75e-6883aca0991d-kube-api-access-7hc94\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.340501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.340358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51652710-debf-4da7-a75e-6883aca0991d-maas-api-tls\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.340501 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:48.340446    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 07 23:21:48.340567 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:21:48.340506    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51652710-debf-4da7-a75e-6883aca0991d-maas-api-tls podName:51652710-debf-4da7-a75e-6883aca0991d nodeName:}" failed. No retries permitted until 2026-07-07 23:21:48.840489704 +0000 UTC m=+640.060473771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/51652710-debf-4da7-a75e-6883aca0991d-maas-api-tls") pod "maas-api-749469ff7f-w2hkn" (UID: "51652710-debf-4da7-a75e-6883aca0991d") : secret "maas-api-serving-cert" not found
Jul 07 23:21:48.340893 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.340875    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51652710-debf-4da7-a75e-6883aca0991d-openshift-service-ca\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.359377 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.359348    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hc94\" (UniqueName: \"kubernetes.io/projected/51652710-debf-4da7-a75e-6883aca0991d-kube-api-access-7hc94\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.752728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.752683    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5g6fh"]
Jul 07 23:21:48.758052 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.758023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:48.760525 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.760505    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6wpvf\""
Jul 07 23:21:48.760672 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.760506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 23:21:48.768940 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.768916    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5g6fh"]
Jul 07 23:21:48.852289 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.852248    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8462f7e6-27b5-4ee3-98c0-7af03a8109b3-plugins-config-volume\") pod \"payload-processing-58f86c7798-5g6fh\" (UID: \"8462f7e6-27b5-4ee3-98c0-7af03a8109b3\") " pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:48.852455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.852376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdjf\" (UniqueName: \"kubernetes.io/projected/8462f7e6-27b5-4ee3-98c0-7af03a8109b3-kube-api-access-xsdjf\") pod \"payload-processing-58f86c7798-5g6fh\" (UID: \"8462f7e6-27b5-4ee3-98c0-7af03a8109b3\") " pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:48.852512 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.852465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51652710-debf-4da7-a75e-6883aca0991d-maas-api-tls\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.855013 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.854990    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51652710-debf-4da7-a75e-6883aca0991d-maas-api-tls\") pod \"maas-api-749469ff7f-w2hkn\" (UID: \"51652710-debf-4da7-a75e-6883aca0991d\") " pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:48.953579 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.953540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdjf\" (UniqueName: \"kubernetes.io/projected/8462f7e6-27b5-4ee3-98c0-7af03a8109b3-kube-api-access-xsdjf\") pod \"payload-processing-58f86c7798-5g6fh\" (UID: \"8462f7e6-27b5-4ee3-98c0-7af03a8109b3\") " pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:48.953765 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.953687    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8462f7e6-27b5-4ee3-98c0-7af03a8109b3-plugins-config-volume\") pod \"payload-processing-58f86c7798-5g6fh\" (UID: \"8462f7e6-27b5-4ee3-98c0-7af03a8109b3\") " pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:48.954473 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.954451    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8462f7e6-27b5-4ee3-98c0-7af03a8109b3-plugins-config-volume\") pod \"payload-processing-58f86c7798-5g6fh\" (UID: \"8462f7e6-27b5-4ee3-98c0-7af03a8109b3\") " pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:48.961898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:48.961869    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdjf\" (UniqueName: \"kubernetes.io/projected/8462f7e6-27b5-4ee3-98c0-7af03a8109b3-kube-api-access-xsdjf\") pod \"payload-processing-58f86c7798-5g6fh\" (UID: \"8462f7e6-27b5-4ee3-98c0-7af03a8109b3\") " pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:49.071264 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:49.071226    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:49.114575 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:49.114486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:49.223414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:49.223386    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5g6fh"]
Jul 07 23:21:49.225288 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:21:49.225258    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8462f7e6_27b5_4ee3_98c0_7af03a8109b3.slice/crio-edca4539bee1798add336a60109824a0f367e7a28d7c6b5dcb4e4abad74dd5e4 WatchSource:0}: Error finding container edca4539bee1798add336a60109824a0f367e7a28d7c6b5dcb4e4abad74dd5e4: Status 404 returned error can't find the container with id edca4539bee1798add336a60109824a0f367e7a28d7c6b5dcb4e4abad74dd5e4
Jul 07 23:21:49.227321 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:49.227303    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 23:21:49.275293 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:49.275273    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"]
Jul 07 23:21:49.277889 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:21:49.277860    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51652710_debf_4da7_a75e_6883aca0991d.slice/crio-f1bd9de03d2a6f1fc2abbc7f1004a4f7fd812f7a9c9244c0e750d2aa3d03edbc WatchSource:0}: Error finding container f1bd9de03d2a6f1fc2abbc7f1004a4f7fd812f7a9c9244c0e750d2aa3d03edbc: Status 404 returned error can't find the container with id f1bd9de03d2a6f1fc2abbc7f1004a4f7fd812f7a9c9244c0e750d2aa3d03edbc
Jul 07 23:21:49.885290 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:49.885248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn" event={"ID":"51652710-debf-4da7-a75e-6883aca0991d","Type":"ContainerStarted","Data":"f1bd9de03d2a6f1fc2abbc7f1004a4f7fd812f7a9c9244c0e750d2aa3d03edbc"}
Jul 07 23:21:49.886365 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:49.886338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5g6fh" event={"ID":"8462f7e6-27b5-4ee3-98c0-7af03a8109b3","Type":"ContainerStarted","Data":"edca4539bee1798add336a60109824a0f367e7a28d7c6b5dcb4e4abad74dd5e4"}
Jul 07 23:21:50.895693 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:50.895604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5g6fh" event={"ID":"8462f7e6-27b5-4ee3-98c0-7af03a8109b3","Type":"ContainerStarted","Data":"f4227dd1ef10e0c7ac1fc7f3840749a13de16d49642fa94171bec05facfb1182"}
Jul 07 23:21:50.895693 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:50.895670    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:21:50.915800 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:50.915757    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-5g6fh" podStartSLOduration=1.583169445 podStartE2EDuration="2.915742688s" totalImagesPullingTime="1.332573243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:21:50.912623329 +0000 UTC m=+642.132607432" watchObservedRunningTime="2026-07-07 23:21:50.915742688 +0000 UTC m=+642.135726777"
Jul 07 23:21:51.902483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:51.902438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn" event={"ID":"51652710-debf-4da7-a75e-6883aca0991d","Type":"ContainerStarted","Data":"eea7420215d2cb4611f6ccf0b26e0730dd3c8e6c076b155acae80eed35d92023"}
Jul 07 23:21:51.902925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:51.902651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:21:51.922994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:51.922947    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn" podStartSLOduration=2.185547958 podStartE2EDuration="3.922932102s" totalImagesPullingTime="1.737384144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:21:51.920553915 +0000 UTC m=+643.140538005" watchObservedRunningTime="2026-07-07 23:21:51.922932102 +0000 UTC m=+643.142916248"
Jul 07 23:21:57.913732 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:21:57.913704    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-749469ff7f-w2hkn"
Jul 07 23:22:01.904543 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:01.904509    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-5g6fh"
Jul 07 23:22:42.376627 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.376590    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"]
Jul 07 23:22:42.380252 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.380232    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.382784 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.382759    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 23:22:42.382899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.382766    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 23:22:42.383787 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.383769    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 23:22:42.383904 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.383852    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vcn5l\""
Jul 07 23:22:42.389635 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.389615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"]
Jul 07 23:22:42.418052 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.418019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.418052 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.418056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.418327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.418073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95gsq\" (UniqueName: \"kubernetes.io/projected/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-kube-api-access-95gsq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.418327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.418111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.418327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.418234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.418327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.418306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519157 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519157 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519468 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95gsq\" (UniqueName: \"kubernetes.io/projected/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-kube-api-access-95gsq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519468 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519468 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519468 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519645 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519618    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519662    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.519706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.519685    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.521474 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.521449    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.521708 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.521692    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.527826 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.527804    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95gsq\" (UniqueName: \"kubernetes.io/projected/c30781cf-fbd0-42d1-8b9b-61c6a81e660e-kube-api-access-95gsq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xf8pc\" (UID: \"c30781cf-fbd0-42d1-8b9b-61c6a81e660e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.693820 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.693724    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:42.843106 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:42.843055    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"]
Jul 07 23:22:42.845013 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:22:42.844985    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30781cf_fbd0_42d1_8b9b_61c6a81e660e.slice/crio-c0faea26b5443f5a01020dd8ac4946867fdd840b0473db543aac6fdb2dc030c2 WatchSource:0}: Error finding container c0faea26b5443f5a01020dd8ac4946867fdd840b0473db543aac6fdb2dc030c2: Status 404 returned error can't find the container with id c0faea26b5443f5a01020dd8ac4946867fdd840b0473db543aac6fdb2dc030c2
Jul 07 23:22:43.199397 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:43.199361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc" event={"ID":"c30781cf-fbd0-42d1-8b9b-61c6a81e660e","Type":"ContainerStarted","Data":"c0faea26b5443f5a01020dd8ac4946867fdd840b0473db543aac6fdb2dc030c2"}
Jul 07 23:22:44.206162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:44.206051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc" event={"ID":"c30781cf-fbd0-42d1-8b9b-61c6a81e660e","Type":"ContainerStarted","Data":"52bc1a218116f40705a600090b5074972f448887617c307e40a3a9a28e213016"}
Jul 07 23:22:44.223902 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:44.223838    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc" podStartSLOduration=1.193685029 podStartE2EDuration="2.22381875s" totalImagesPullingTime="1.030133721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:22:44.221870844 +0000 UTC m=+695.441854933" watchObservedRunningTime="2026-07-07 23:22:44.22381875 +0000 UTC m=+695.443802841"
Jul 07 23:22:52.694352 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:52.694309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:52.694862 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:52.694404    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:52.707080 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:52.707054    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:22:53.269838 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:22:53.269812    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xf8pc"
Jul 07 23:24:18.605915 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.605879    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f998d847-m9rz2"]
Jul 07 23:24:18.606622 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.606070    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75f998d847-m9rz2" podUID="5f8c4034-62fd-4c56-94d4-301904c3c8f1" containerName="authorino" containerID="cri-o://e7ea19d9ec2d85c33b539fd504cd2c90d16fa3794c19e4bcb388c5cb75ac946a" gracePeriod=30
Jul 07 23:24:18.751210 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.751180    2581 generic.go:356] "Generic (PLEG): container finished" podID="5f8c4034-62fd-4c56-94d4-301904c3c8f1" containerID="e7ea19d9ec2d85c33b539fd504cd2c90d16fa3794c19e4bcb388c5cb75ac946a" exitCode=0
Jul 07 23:24:18.751356 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.751250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f998d847-m9rz2" event={"ID":"5f8c4034-62fd-4c56-94d4-301904c3c8f1","Type":"ContainerDied","Data":"e7ea19d9ec2d85c33b539fd504cd2c90d16fa3794c19e4bcb388c5cb75ac946a"}
Jul 07 23:24:18.871144 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.871079    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:24:18.975663 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.975636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gr9k\" (UniqueName: \"kubernetes.io/projected/5f8c4034-62fd-4c56-94d4-301904c3c8f1-kube-api-access-2gr9k\") pod \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") "
Jul 07 23:24:18.975862 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.975693    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f8c4034-62fd-4c56-94d4-301904c3c8f1-tls-cert\") pod \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\" (UID: \"5f8c4034-62fd-4c56-94d4-301904c3c8f1\") "
Jul 07 23:24:18.977760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.977724    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8c4034-62fd-4c56-94d4-301904c3c8f1-kube-api-access-2gr9k" (OuterVolumeSpecName: "kube-api-access-2gr9k") pod "5f8c4034-62fd-4c56-94d4-301904c3c8f1" (UID: "5f8c4034-62fd-4c56-94d4-301904c3c8f1"). InnerVolumeSpecName "kube-api-access-2gr9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:24:18.986594 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:18.986567    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f8c4034-62fd-4c56-94d4-301904c3c8f1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5f8c4034-62fd-4c56-94d4-301904c3c8f1" (UID: "5f8c4034-62fd-4c56-94d4-301904c3c8f1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:24:19.076900 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:19.076869    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gr9k\" (UniqueName: \"kubernetes.io/projected/5f8c4034-62fd-4c56-94d4-301904c3c8f1-kube-api-access-2gr9k\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:24:19.076900 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:19.076895    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f8c4034-62fd-4c56-94d4-301904c3c8f1-tls-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:24:19.757858 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:19.757830    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f998d847-m9rz2"
Jul 07 23:24:19.758318 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:19.757873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f998d847-m9rz2" event={"ID":"5f8c4034-62fd-4c56-94d4-301904c3c8f1","Type":"ContainerDied","Data":"0114d31a4669a72527fa2698bf476b74796ccfb185a17e148f4440cc646353da"}
Jul 07 23:24:19.758318 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:19.757919    2581 scope.go:117] "RemoveContainer" containerID="e7ea19d9ec2d85c33b539fd504cd2c90d16fa3794c19e4bcb388c5cb75ac946a"
Jul 07 23:24:19.779069 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:19.779034    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f998d847-m9rz2"]
Jul 07 23:24:19.781742 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:19.781721    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75f998d847-m9rz2"]
Jul 07 23:24:21.503345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:24:21.503312    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f8c4034-62fd-4c56-94d4-301904c3c8f1" path="/var/lib/kubelet/pods/5f8c4034-62fd-4c56-94d4-301904c3c8f1/volumes"
Jul 07 23:25:29.012902 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.012866    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54d6fc6777-nwwnj"]
Jul 07 23:25:29.013354 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.013075    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54d6fc6777-nwwnj" podUID="b6af453a-dfdb-4f49-824a-193a03896eca" containerName="manager" containerID="cri-o://6c7cb9d4f56acc67fac3f466587cab90fea8eb5b47ebe4ef9c756ba0802d1797" gracePeriod=30
Jul 07 23:25:29.149585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.149550    2581 generic.go:356] "Generic (PLEG): container finished" podID="b6af453a-dfdb-4f49-824a-193a03896eca" containerID="6c7cb9d4f56acc67fac3f466587cab90fea8eb5b47ebe4ef9c756ba0802d1797" exitCode=0
Jul 07 23:25:29.149748 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.149599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d6fc6777-nwwnj" event={"ID":"b6af453a-dfdb-4f49-824a-193a03896eca","Type":"ContainerDied","Data":"6c7cb9d4f56acc67fac3f466587cab90fea8eb5b47ebe4ef9c756ba0802d1797"}
Jul 07 23:25:29.269855 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.269798    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:25:29.288507 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.288482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gpxq\" (UniqueName: \"kubernetes.io/projected/b6af453a-dfdb-4f49-824a-193a03896eca-kube-api-access-7gpxq\") pod \"b6af453a-dfdb-4f49-824a-193a03896eca\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") "
Jul 07 23:25:29.288649 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.288526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert\") pod \"b6af453a-dfdb-4f49-824a-193a03896eca\" (UID: \"b6af453a-dfdb-4f49-824a-193a03896eca\") "
Jul 07 23:25:29.290747 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.290722    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6af453a-dfdb-4f49-824a-193a03896eca-kube-api-access-7gpxq" (OuterVolumeSpecName: "kube-api-access-7gpxq") pod "b6af453a-dfdb-4f49-824a-193a03896eca" (UID: "b6af453a-dfdb-4f49-824a-193a03896eca"). InnerVolumeSpecName "kube-api-access-7gpxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:25:29.291642 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.291601    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b6af453a-dfdb-4f49-824a-193a03896eca" (UID: "b6af453a-dfdb-4f49-824a-193a03896eca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:25:29.389261 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.389230    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gpxq\" (UniqueName: \"kubernetes.io/projected/b6af453a-dfdb-4f49-824a-193a03896eca-kube-api-access-7gpxq\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:25:29.389261 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:29.389258    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6af453a-dfdb-4f49-824a-193a03896eca-webhook-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:25:30.155750 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.155721    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d6fc6777-nwwnj"
Jul 07 23:25:30.156239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.155763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d6fc6777-nwwnj" event={"ID":"b6af453a-dfdb-4f49-824a-193a03896eca","Type":"ContainerDied","Data":"0b7c90347ac2fe9908683a912b990afb46e72c35bf9a04c04bc6ea9a380c8b15"}
Jul 07 23:25:30.156239 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.155831    2581 scope.go:117] "RemoveContainer" containerID="6c7cb9d4f56acc67fac3f466587cab90fea8eb5b47ebe4ef9c756ba0802d1797"
Jul 07 23:25:30.172630 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.172608    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54d6fc6777-nwwnj"]
Jul 07 23:25:30.175959 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.175936    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54d6fc6777-nwwnj"]
Jul 07 23:25:30.978408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.978365    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54d6fc6777-rl2xf"]
Jul 07 23:25:30.978917 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.978896    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8c4034-62fd-4c56-94d4-301904c3c8f1" containerName="authorino"
Jul 07 23:25:30.978917 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.978915    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8c4034-62fd-4c56-94d4-301904c3c8f1" containerName="authorino"
Jul 07 23:25:30.979124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.978927    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6af453a-dfdb-4f49-824a-193a03896eca" containerName="manager"
Jul 07 23:25:30.979124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.978936    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6af453a-dfdb-4f49-824a-193a03896eca" containerName="manager"
Jul 07 23:25:30.979124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.979014    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6af453a-dfdb-4f49-824a-193a03896eca" containerName="manager"
Jul 07 23:25:30.979124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.979028    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f8c4034-62fd-4c56-94d4-301904c3c8f1" containerName="authorino"
Jul 07 23:25:30.983420 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.983406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:30.985780 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.985760    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 23:25:30.985892 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.985765    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ng6c5\""
Jul 07 23:25:30.985892 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.985770    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 23:25:30.990685 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:30.990662    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54d6fc6777-rl2xf"]
Jul 07 23:25:31.000903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.000880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4xwr\" (UniqueName: \"kubernetes.io/projected/202107b5-93d0-4ff9-a32d-ab020ff10b61-kube-api-access-f4xwr\") pod \"maas-controller-54d6fc6777-rl2xf\" (UID: \"202107b5-93d0-4ff9-a32d-ab020ff10b61\") " pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:31.001021 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.000934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/202107b5-93d0-4ff9-a32d-ab020ff10b61-webhook-cert\") pod \"maas-controller-54d6fc6777-rl2xf\" (UID: \"202107b5-93d0-4ff9-a32d-ab020ff10b61\") " pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:31.102176 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.102139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/202107b5-93d0-4ff9-a32d-ab020ff10b61-webhook-cert\") pod \"maas-controller-54d6fc6777-rl2xf\" (UID: \"202107b5-93d0-4ff9-a32d-ab020ff10b61\") " pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:31.102425 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.102271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4xwr\" (UniqueName: \"kubernetes.io/projected/202107b5-93d0-4ff9-a32d-ab020ff10b61-kube-api-access-f4xwr\") pod \"maas-controller-54d6fc6777-rl2xf\" (UID: \"202107b5-93d0-4ff9-a32d-ab020ff10b61\") " pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:31.104515 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.104485    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/202107b5-93d0-4ff9-a32d-ab020ff10b61-webhook-cert\") pod \"maas-controller-54d6fc6777-rl2xf\" (UID: \"202107b5-93d0-4ff9-a32d-ab020ff10b61\") " pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:31.110480 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.110462    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4xwr\" (UniqueName: \"kubernetes.io/projected/202107b5-93d0-4ff9-a32d-ab020ff10b61-kube-api-access-f4xwr\") pod \"maas-controller-54d6fc6777-rl2xf\" (UID: \"202107b5-93d0-4ff9-a32d-ab020ff10b61\") " pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:31.295247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.295220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:31.446229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.446191    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54d6fc6777-rl2xf"]
Jul 07 23:25:31.447884 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:25:31.447850    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202107b5_93d0_4ff9_a32d_ab020ff10b61.slice/crio-a55d2cb845e1fe771fabd109ab4e9452105d519becf5842516117c70213662b2 WatchSource:0}: Error finding container a55d2cb845e1fe771fabd109ab4e9452105d519becf5842516117c70213662b2: Status 404 returned error can't find the container with id a55d2cb845e1fe771fabd109ab4e9452105d519becf5842516117c70213662b2
Jul 07 23:25:31.503014 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:31.502991    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6af453a-dfdb-4f49-824a-193a03896eca" path="/var/lib/kubelet/pods/b6af453a-dfdb-4f49-824a-193a03896eca/volumes"
Jul 07 23:25:32.170025 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:32.169994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d6fc6777-rl2xf" event={"ID":"202107b5-93d0-4ff9-a32d-ab020ff10b61","Type":"ContainerStarted","Data":"5c88b3eff2e7e39fdd3d72ab772bbaddf576402fb823559312fb9b1a82145dc7"}
Jul 07 23:25:32.170197 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:32.170050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d6fc6777-rl2xf" event={"ID":"202107b5-93d0-4ff9-a32d-ab020ff10b61","Type":"ContainerStarted","Data":"a55d2cb845e1fe771fabd109ab4e9452105d519becf5842516117c70213662b2"}
Jul 07 23:25:32.170197 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:32.170183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:25:32.186523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:32.186480    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54d6fc6777-rl2xf" podStartSLOduration=1.625999824 podStartE2EDuration="2.186466156s" totalImagesPullingTime="560.466332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:25:32.185436511 +0000 UTC m=+863.405420600" watchObservedRunningTime="2026-07-07 23:25:32.186466156 +0000 UTC m=+863.406450245"
Jul 07 23:25:43.181514 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:25:43.181484    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54d6fc6777-rl2xf"
Jul 07 23:26:11.337921 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:26:11.337893    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:26:11.344278 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:26:11.344251    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:30:00.146157 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.146122    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"]
Jul 07 23:30:00.149866 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.149850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"
Jul 07 23:30:00.164971 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.164944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"]
Jul 07 23:30:00.190045 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.190018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkv66\" (UniqueName: \"kubernetes.io/projected/4789740c-bf76-4989-a09d-fb30b3645652-kube-api-access-nkv66\") pod \"maas-api-key-cleanup-29724450-bjvq2\" (UID: \"4789740c-bf76-4989-a09d-fb30b3645652\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"
Jul 07 23:30:00.290645 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.290606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkv66\" (UniqueName: \"kubernetes.io/projected/4789740c-bf76-4989-a09d-fb30b3645652-kube-api-access-nkv66\") pod \"maas-api-key-cleanup-29724450-bjvq2\" (UID: \"4789740c-bf76-4989-a09d-fb30b3645652\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"
Jul 07 23:30:00.298942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.298911    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkv66\" (UniqueName: \"kubernetes.io/projected/4789740c-bf76-4989-a09d-fb30b3645652-kube-api-access-nkv66\") pod \"maas-api-key-cleanup-29724450-bjvq2\" (UID: \"4789740c-bf76-4989-a09d-fb30b3645652\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"
Jul 07 23:30:00.460632 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.460550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"
Jul 07 23:30:00.595137 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.595092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"]
Jul 07 23:30:00.598184 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:30:00.598155    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4789740c_bf76_4989_a09d_fb30b3645652.slice/crio-00398a3360cb2f5cf7876552e2a00cd0bd0a7cfe7768befccaf74c713822a4d4 WatchSource:0}: Error finding container 00398a3360cb2f5cf7876552e2a00cd0bd0a7cfe7768befccaf74c713822a4d4: Status 404 returned error can't find the container with id 00398a3360cb2f5cf7876552e2a00cd0bd0a7cfe7768befccaf74c713822a4d4
Jul 07 23:30:00.600032 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.600017    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 23:30:00.718983 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:00.718902    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2" event={"ID":"4789740c-bf76-4989-a09d-fb30b3645652","Type":"ContainerStarted","Data":"00398a3360cb2f5cf7876552e2a00cd0bd0a7cfe7768befccaf74c713822a4d4"}
Jul 07 23:30:03.740299 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:03.740275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2" event={"ID":"4789740c-bf76-4989-a09d-fb30b3645652","Type":"ContainerStarted","Data":"b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d"}
Jul 07 23:30:03.755852 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:03.755810    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2" podStartSLOduration=0.916886893 podStartE2EDuration="3.755795663s" totalImagesPullingTime="2.83890877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:30:03.753999339 +0000 UTC m=+1134.973983425" watchObservedRunningTime="2026-07-07 23:30:03.755795663 +0000 UTC m=+1134.975779746"
Jul 07 23:30:17.186793 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:17.186759    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"]
Jul 07 23:30:17.187360 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:17.186981    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z" podUID="999f213b-279f-448b-b6cc-f9dd62a8f18e" containerName="manager" containerID="cri-o://3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2" gracePeriod=10
Jul 07 23:30:20.048762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.048739    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:30:20.176906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.176818    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/999f213b-279f-448b-b6cc-f9dd62a8f18e-extensions-socket-volume\") pod \"999f213b-279f-448b-b6cc-f9dd62a8f18e\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") "
Jul 07 23:30:20.177053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.176911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/999f213b-279f-448b-b6cc-f9dd62a8f18e-kube-api-access-2vsv9\") pod \"999f213b-279f-448b-b6cc-f9dd62a8f18e\" (UID: \"999f213b-279f-448b-b6cc-f9dd62a8f18e\") "
Jul 07 23:30:20.177201 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.177176    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/999f213b-279f-448b-b6cc-f9dd62a8f18e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "999f213b-279f-448b-b6cc-f9dd62a8f18e" (UID: "999f213b-279f-448b-b6cc-f9dd62a8f18e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:30:20.178903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.178876    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999f213b-279f-448b-b6cc-f9dd62a8f18e-kube-api-access-2vsv9" (OuterVolumeSpecName: "kube-api-access-2vsv9") pod "999f213b-279f-448b-b6cc-f9dd62a8f18e" (UID: "999f213b-279f-448b-b6cc-f9dd62a8f18e"). InnerVolumeSpecName "kube-api-access-2vsv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:30:20.277905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.277870    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/999f213b-279f-448b-b6cc-f9dd62a8f18e-kube-api-access-2vsv9\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:30:20.277905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.277900    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/999f213b-279f-448b-b6cc-f9dd62a8f18e-extensions-socket-volume\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:30:20.839506 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.839469    2581 generic.go:356] "Generic (PLEG): container finished" podID="999f213b-279f-448b-b6cc-f9dd62a8f18e" containerID="3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2" exitCode=0
Jul 07 23:30:20.839674 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.839513    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"
Jul 07 23:30:20.839674 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.839553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z" event={"ID":"999f213b-279f-448b-b6cc-f9dd62a8f18e","Type":"ContainerDied","Data":"3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2"}
Jul 07 23:30:20.839674 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.839611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z" event={"ID":"999f213b-279f-448b-b6cc-f9dd62a8f18e","Type":"ContainerDied","Data":"c59213376c12db5128bd7cbaa8ff4358b946c99b69e7c6f723b605b42540c34d"}
Jul 07 23:30:20.839674 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.839639    2581 scope.go:117] "RemoveContainer" containerID="3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2"
Jul 07 23:30:20.850032 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.850013    2581 scope.go:117] "RemoveContainer" containerID="3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2"
Jul 07 23:30:20.850283 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:30:20.850263    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2\": container with ID starting with 3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2 not found: ID does not exist" containerID="3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2"
Jul 07 23:30:20.850334 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.850290    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2"} err="failed to get container status \"3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2\": rpc error: code = NotFound desc = could not find container \"3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2\": container with ID starting with 3028db5f004b984ba9affe13082c5657add8e2c457500983e6491d7745ab8ad2 not found: ID does not exist"
Jul 07 23:30:20.862186 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.862167    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"]
Jul 07 23:30:20.865589 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:20.865558    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-drm2z"]
Jul 07 23:30:21.502753 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:30:21.502719    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="999f213b-279f-448b-b6cc-f9dd62a8f18e" path="/var/lib/kubelet/pods/999f213b-279f-448b-b6cc-f9dd62a8f18e/volumes"
Jul 07 23:31:00.011309 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:00.011217    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"]
Jul 07 23:31:00.011871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:00.011459    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2" podUID="4789740c-bf76-4989-a09d-fb30b3645652" containerName="cleanup" containerID="cri-o://b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d" gracePeriod=30
Jul 07 23:31:11.383442 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:11.383325    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:31:11.391128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:11.391089    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:31:18.384554 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.384508    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"]
Jul 07 23:31:18.385017 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.385001    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999f213b-279f-448b-b6cc-f9dd62a8f18e" containerName="manager"
Jul 07 23:31:18.385076 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.385040    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="999f213b-279f-448b-b6cc-f9dd62a8f18e" containerName="manager"
Jul 07 23:31:18.385178 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.385167    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="999f213b-279f-448b-b6cc-f9dd62a8f18e" containerName="manager"
Jul 07 23:31:18.388261 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.388247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.391167 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.391146    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mkt55\""
Jul 07 23:31:18.399653 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.399632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"]
Jul 07 23:31:18.479240 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.479203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cttlb\" (UniqueName: \"kubernetes.io/projected/322da3bf-6b5c-441c-a6aa-d56ced04f950-kube-api-access-cttlb\") pod \"kuadrant-operator-controller-manager-86878c769f-9csbb\" (UID: \"322da3bf-6b5c-441c-a6aa-d56ced04f950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.479414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.479249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/322da3bf-6b5c-441c-a6aa-d56ced04f950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9csbb\" (UID: \"322da3bf-6b5c-441c-a6aa-d56ced04f950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.580577 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.580546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/322da3bf-6b5c-441c-a6aa-d56ced04f950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9csbb\" (UID: \"322da3bf-6b5c-441c-a6aa-d56ced04f950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.580726 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.580662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cttlb\" (UniqueName: \"kubernetes.io/projected/322da3bf-6b5c-441c-a6aa-d56ced04f950-kube-api-access-cttlb\") pod \"kuadrant-operator-controller-manager-86878c769f-9csbb\" (UID: \"322da3bf-6b5c-441c-a6aa-d56ced04f950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.580928 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.580908    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/322da3bf-6b5c-441c-a6aa-d56ced04f950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9csbb\" (UID: \"322da3bf-6b5c-441c-a6aa-d56ced04f950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.588584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.588559    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cttlb\" (UniqueName: \"kubernetes.io/projected/322da3bf-6b5c-441c-a6aa-d56ced04f950-kube-api-access-cttlb\") pod \"kuadrant-operator-controller-manager-86878c769f-9csbb\" (UID: \"322da3bf-6b5c-441c-a6aa-d56ced04f950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.699815 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.699720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:18.850852 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:18.850825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"]
Jul 07 23:31:18.853835 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:31:18.853810    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322da3bf_6b5c_441c_a6aa_d56ced04f950.slice/crio-dddac0ba31300b5a62fee22fc438fd64a98d051b7e2b7fd163a7ed47462fb459 WatchSource:0}: Error finding container dddac0ba31300b5a62fee22fc438fd64a98d051b7e2b7fd163a7ed47462fb459: Status 404 returned error can't find the container with id dddac0ba31300b5a62fee22fc438fd64a98d051b7e2b7fd163a7ed47462fb459
Jul 07 23:31:19.165304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:19.165269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb" event={"ID":"322da3bf-6b5c-441c-a6aa-d56ced04f950","Type":"ContainerStarted","Data":"0bda174a0da84c1aa5009d7c40c5754adf583d323c83972aeed8cd770dfa52c8"}
Jul 07 23:31:19.165493 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:19.165328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb" event={"ID":"322da3bf-6b5c-441c-a6aa-d56ced04f950","Type":"ContainerStarted","Data":"dddac0ba31300b5a62fee22fc438fd64a98d051b7e2b7fd163a7ed47462fb459"}
Jul 07 23:31:19.165493 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:19.165469    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:19.187183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:19.187136    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb" podStartSLOduration=1.1871215 podStartE2EDuration="1.1871215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:31:19.184024959 +0000 UTC m=+1210.404009059" watchObservedRunningTime="2026-07-07 23:31:19.1871215 +0000 UTC m=+1210.407105589"
Jul 07 23:31:30.173988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.173944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9csbb"
Jul 07 23:31:30.196715 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.196687    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"
Jul 07 23:31:30.230011 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.229980    2581 generic.go:356] "Generic (PLEG): container finished" podID="4789740c-bf76-4989-a09d-fb30b3645652" containerID="b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d" exitCode=137
Jul 07 23:31:30.230211 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.230041    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"
Jul 07 23:31:30.230211 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.230060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2" event={"ID":"4789740c-bf76-4989-a09d-fb30b3645652","Type":"ContainerDied","Data":"b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d"}
Jul 07 23:31:30.230211 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.230154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2" event={"ID":"4789740c-bf76-4989-a09d-fb30b3645652","Type":"ContainerDied","Data":"00398a3360cb2f5cf7876552e2a00cd0bd0a7cfe7768befccaf74c713822a4d4"}
Jul 07 23:31:30.230211 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.230179    2581 scope.go:117] "RemoveContainer" containerID="b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d"
Jul 07 23:31:30.240879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.240862    2581 scope.go:117] "RemoveContainer" containerID="b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d"
Jul 07 23:31:30.241182 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:31:30.241162    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d\": container with ID starting with b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d not found: ID does not exist" containerID="b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d"
Jul 07 23:31:30.241266 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.241196    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d"} err="failed to get container status \"b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d\": rpc error: code = NotFound desc = could not find container \"b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d\": container with ID starting with b9e300fb4bb75bfa1f565383d7b43fd17c25276eb65b1ea3c7c585095711201d not found: ID does not exist"
Jul 07 23:31:30.284671 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.284602    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkv66\" (UniqueName: \"kubernetes.io/projected/4789740c-bf76-4989-a09d-fb30b3645652-kube-api-access-nkv66\") pod \"4789740c-bf76-4989-a09d-fb30b3645652\" (UID: \"4789740c-bf76-4989-a09d-fb30b3645652\") "
Jul 07 23:31:30.286688 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.286659    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4789740c-bf76-4989-a09d-fb30b3645652-kube-api-access-nkv66" (OuterVolumeSpecName: "kube-api-access-nkv66") pod "4789740c-bf76-4989-a09d-fb30b3645652" (UID: "4789740c-bf76-4989-a09d-fb30b3645652"). InnerVolumeSpecName "kube-api-access-nkv66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:31:30.385968 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.385934    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkv66\" (UniqueName: \"kubernetes.io/projected/4789740c-bf76-4989-a09d-fb30b3645652-kube-api-access-nkv66\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:31:30.553083 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.553051    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"]
Jul 07 23:31:30.561568 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:30.561540    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724450-bjvq2"]
Jul 07 23:31:31.503238 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:31:31.503206    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4789740c-bf76-4989-a09d-fb30b3645652" path="/var/lib/kubelet/pods/4789740c-bf76-4989-a09d-fb30b3645652/volumes"
Jul 07 23:36:11.421722 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:36:11.421598    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:36:11.433524 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:36:11.433495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:37:36.477945 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.477911    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"]
Jul 07 23:37:36.478489 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.478474    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4789740c-bf76-4989-a09d-fb30b3645652" containerName="cleanup"
Jul 07 23:37:36.478545 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.478492    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4789740c-bf76-4989-a09d-fb30b3645652" containerName="cleanup"
Jul 07 23:37:36.478607 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.478595    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4789740c-bf76-4989-a09d-fb30b3645652" containerName="cleanup"
Jul 07 23:37:36.481360 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.481342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.484235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.484215    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 23:37:36.484358 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.484216    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-59ab92de-openshift-default-dockercfg-vw265\""
Jul 07 23:37:36.506638 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.506610    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"]
Jul 07 23:37:36.663789 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.663750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-envoy\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.663952 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.663797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-data\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.663952 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.663875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-socket\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.663952 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.663905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-token\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.664066 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.663972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-credential-socket\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.664066 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.664004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-podinfo\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.664164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.664066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkk7d\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-kube-api-access-xkk7d\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.664164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.664089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-certs\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.664164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.664125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2336d4f2-50c4-4de5-b009-8b980457b2a8-istiod-ca-cert\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-envoy\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-data\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765684 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-socket\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765684 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-token\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765684 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-credential-socket\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765684 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-podinfo\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765684 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkk7d\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-kube-api-access-xkk7d\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765951 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-certs\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.765951 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.765721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2336d4f2-50c4-4de5-b009-8b980457b2a8-istiod-ca-cert\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.766055 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.766009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-socket\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.766055 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.766029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-credential-socket\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.766163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.766150    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-data\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.766231 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.766210    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-certs\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.766399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.766384    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2336d4f2-50c4-4de5-b009-8b980457b2a8-istiod-ca-cert\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.767765 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.767743    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-envoy\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.768093 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.768073    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-podinfo\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.774273 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.774254    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkk7d\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-kube-api-access-xkk7d\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.775479 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.775463    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-token\") pod \"e2e-ait-59ab92de-openshift-default-599899bdfc-shppv\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") " pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.795625 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.795607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:36.935323 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.935298    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"]
Jul 07 23:37:36.936323 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:37:36.936292    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2336d4f2_50c4_4de5_b009_8b980457b2a8.slice/crio-63b9d77b2e5433f6eaa26c18377bc6fa84fce3b192b00506b47e58dc256da950 WatchSource:0}: Error finding container 63b9d77b2e5433f6eaa26c18377bc6fa84fce3b192b00506b47e58dc256da950: Status 404 returned error can't find the container with id 63b9d77b2e5433f6eaa26c18377bc6fa84fce3b192b00506b47e58dc256da950
Jul 07 23:37:36.938546 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:36.938526    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 23:37:37.340065 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.340032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv" event={"ID":"2336d4f2-50c4-4de5-b009-8b980457b2a8","Type":"ContainerStarted","Data":"63b9d77b2e5433f6eaa26c18377bc6fa84fce3b192b00506b47e58dc256da950"}
Jul 07 23:37:37.794985 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.794956    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"]
Jul 07 23:37:37.798668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.798642    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:37.801451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.801390    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-59ab92de-serving-cert\""
Jul 07 23:37:37.810063 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.810038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"]
Jul 07 23:37:37.977303 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.977261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-openshift-service-ca\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:37.977487 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.977322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cm27\" (UniqueName: \"kubernetes.io/projected/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-kube-api-access-8cm27\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:37.977487 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:37.977416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-maas-api-tls\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.078398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.078309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-openshift-service-ca\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.078398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.078351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cm27\" (UniqueName: \"kubernetes.io/projected/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-kube-api-access-8cm27\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.078398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.078374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-maas-api-tls\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.079037 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.079013    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-openshift-service-ca\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.080925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.080904    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-maas-api-tls\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.091055 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.091023    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cm27\" (UniqueName: \"kubernetes.io/projected/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-kube-api-access-8cm27\") pod \"maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.114817 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.114788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:38.282929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.282906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"]
Jul 07 23:37:38.284502 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:37:38.284473    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9803fa4d_aa1f_4e4b_b30f_6a9ef4e0ce43.slice/crio-4422e63d94a87624b842c9ab23a60532e035a497cee1caef2b8f72cdbe70f547 WatchSource:0}: Error finding container 4422e63d94a87624b842c9ab23a60532e035a497cee1caef2b8f72cdbe70f547: Status 404 returned error can't find the container with id 4422e63d94a87624b842c9ab23a60532e035a497cee1caef2b8f72cdbe70f547
Jul 07 23:37:38.348486 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:38.348402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9" event={"ID":"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43","Type":"ContainerStarted","Data":"4422e63d94a87624b842c9ab23a60532e035a497cee1caef2b8f72cdbe70f547"}
Jul 07 23:37:39.357967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:39.357924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9" event={"ID":"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43","Type":"ContainerStarted","Data":"5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592"}
Jul 07 23:37:39.358452 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:39.358125    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:39.378454 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:39.378405    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9" podStartSLOduration=1.895341901 podStartE2EDuration="2.378390934s" totalImagesPullingTime="483.049033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:37:39.375340599 +0000 UTC m=+1590.595324688" watchObservedRunningTime="2026-07-07 23:37:39.378390934 +0000 UTC m=+1590.598375023"
Jul 07 23:37:40.538624 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:40.538588    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:37:40.538893 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:40.538657    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:37:40.538893 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:40.538685    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:37:41.371536 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:41.371498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv" event={"ID":"2336d4f2-50c4-4de5-b009-8b980457b2a8","Type":"ContainerStarted","Data":"7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba"}
Jul 07 23:37:41.391114 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:41.391036    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv" podStartSLOduration=1.791460738 podStartE2EDuration="5.391015797s" totalImagesPullingTime="3.599555059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:37:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:37:41.390400113 +0000 UTC m=+1592.610384205" watchObservedRunningTime="2026-07-07 23:37:41.391015797 +0000 UTC m=+1592.610999947"
Jul 07 23:37:41.796792 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:41.796759    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:41.801782 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:41.801758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:42.377159 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:42.377124    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:42.378065 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:42.378041    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:42.939234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:42.939194    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"]
Jul 07 23:37:43.094380 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.094350    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"]
Jul 07 23:37:43.094585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.094558    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9" podUID="9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" containerName="maas-api" containerID="cri-o://5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592" gracePeriod=30
Jul 07 23:37:43.099890 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.099864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:43.382427 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.382404    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:43.383803 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.383777    2581 generic.go:356] "Generic (PLEG): container finished" podID="9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" containerID="5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592" exitCode=0
Jul 07 23:37:43.383921 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.383816    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"
Jul 07 23:37:43.383921 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.383851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9" event={"ID":"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43","Type":"ContainerDied","Data":"5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592"}
Jul 07 23:37:43.383921 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.383898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9" event={"ID":"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43","Type":"ContainerDied","Data":"4422e63d94a87624b842c9ab23a60532e035a497cee1caef2b8f72cdbe70f547"}
Jul 07 23:37:43.383921 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.383920    2581 scope.go:117] "RemoveContainer" containerID="5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592"
Jul 07 23:37:43.384188 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.384170    2581 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv" secret="" err="secret \"e2e-ait-59ab92de-openshift-default-dockercfg-vw265\" not found"
Jul 07 23:37:43.392838 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.392822    2581 scope.go:117] "RemoveContainer" containerID="5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592"
Jul 07 23:37:43.393062 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:37:43.393040    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592\": container with ID starting with 5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592 not found: ID does not exist" containerID="5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592"
Jul 07 23:37:43.393134 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.393072    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592"} err="failed to get container status \"5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592\": rpc error: code = NotFound desc = could not find container \"5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592\": container with ID starting with 5a25b429e1368ba282592a81cb535a4cde9bab24fef935045e88ad6c7610b592 not found: ID does not exist"
Jul 07 23:37:43.454447 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.454411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cm27\" (UniqueName: \"kubernetes.io/projected/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-kube-api-access-8cm27\") pod \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") "
Jul 07 23:37:43.454659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.454484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-openshift-service-ca\") pod \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") "
Jul 07 23:37:43.454659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.454548    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-maas-api-tls\") pod \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\" (UID: \"9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43\") "
Jul 07 23:37:43.455683 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.455642    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" (UID: "9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:37:43.457722 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.457659    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" (UID: "9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:37:43.457722 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.457679    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-kube-api-access-8cm27" (OuterVolumeSpecName: "kube-api-access-8cm27") pod "9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" (UID: "9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43"). InnerVolumeSpecName "kube-api-access-8cm27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:37:43.555810 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.555769    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cm27\" (UniqueName: \"kubernetes.io/projected/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-kube-api-access-8cm27\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:43.555810 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.555805    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:43.555810 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.555818    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:43.701128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.701081    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"]
Jul 07 23:37:43.705001 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:43.704976    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59ab92de-559b6486cc-sn7f9"]
Jul 07 23:37:44.390219 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:44.390182    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv" podUID="2336d4f2-50c4-4de5-b009-8b980457b2a8" containerName="istio-proxy" containerID="cri-o://7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba" gracePeriod=30
Jul 07 23:37:45.503563 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:45.503529    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" path="/var/lib/kubelet/pods/9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43/volumes"
Jul 07 23:37:49.315696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.315664    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"]
Jul 07 23:37:49.316251 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.316234    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" containerName="maas-api"
Jul 07 23:37:49.316251 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.316253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" containerName="maas-api"
Jul 07 23:37:49.316358 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.316331    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9803fa4d-aa1f-4e4b-b30f-6a9ef4e0ce43" containerName="maas-api"
Jul 07 23:37:49.324611 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.321125    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.330446 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.330419    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-127adb5c-gw-openshift-default-dockercfg-9zqsd\""
Jul 07 23:37:49.332051 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.332026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"]
Jul 07 23:37:49.406914 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.406884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-credential-socket\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.406944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-certs\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.406980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-token\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.407026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-socket\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.407060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6fe967-18dd-4d01-a540-88ff5473a67f-istiod-ca-cert\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.407086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85hx\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-kube-api-access-v85hx\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407416 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.407203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-data\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407416 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.407247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-envoy\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.407416 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.407278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-podinfo\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.507752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-envoy\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.507752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-podinfo\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-credential-socket\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-certs\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-token\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-socket\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6fe967-18dd-4d01-a540-88ff5473a67f-istiod-ca-cert\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85hx\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-kube-api-access-v85hx\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.507964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-data\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.508240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-certs\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.508278    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-credential-socket\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.508461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-socket\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.508510    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-data\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.509398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.508673    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6fe967-18dd-4d01-a540-88ff5473a67f-istiod-ca-cert\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.510280 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.510254    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-envoy\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.510331 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.510265    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-podinfo\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.515873 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.515849    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85hx\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-kube-api-access-v85hx\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.515983 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.515899    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-token\") pod \"e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") " pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.640977 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.640944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:49.746391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.746367    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:49.795898 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.795874    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"]
Jul 07 23:37:49.796925 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:37:49.796900    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6fe967_18dd_4d01_a540_88ff5473a67f.slice/crio-f4fa06b7f6072e005aea5adfc797b77e320d3d3c465232c77ef27bff31276071 WatchSource:0}: Error finding container f4fa06b7f6072e005aea5adfc797b77e320d3d3c465232c77ef27bff31276071: Status 404 returned error can't find the container with id f4fa06b7f6072e005aea5adfc797b77e320d3d3c465232c77ef27bff31276071
Jul 07 23:37:49.798999 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.798969    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:37:49.799057 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.799034    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:37:49.799128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.799061    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:37:49.810557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810529    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-credential-socket\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.810671 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810579    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-envoy\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.810671 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810607    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-data\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.810762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810680    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-podinfo\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.810762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810720    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkk7d\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-kube-api-access-xkk7d\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.810854 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810804    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:37:49.810854 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2336d4f2-50c4-4de5-b009-8b980457b2a8-istiod-ca-cert\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.810961 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-certs\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.811021 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.810965    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-socket\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.811073 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811021    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-token\") pod \"2336d4f2-50c4-4de5-b009-8b980457b2a8\" (UID: \"2336d4f2-50c4-4de5-b009-8b980457b2a8\") "
Jul 07 23:37:49.811298 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811176    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2336d4f2-50c4-4de5-b009-8b980457b2a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:37:49.811648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811378    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:37:49.811648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811478    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2336d4f2-50c4-4de5-b009-8b980457b2a8-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.811648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811496    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.811648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811497    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:37:49.811648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811532    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.811648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.811568    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:37:49.813234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.813209    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:37:49.813349 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.813209    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:37:49.813696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.813673    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:37:49.813774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.813692    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-kube-api-access-xkk7d" (OuterVolumeSpecName: "kube-api-access-xkk7d") pod "2336d4f2-50c4-4de5-b009-8b980457b2a8" (UID: "2336d4f2-50c4-4de5-b009-8b980457b2a8"). InnerVolumeSpecName "kube-api-access-xkk7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:37:49.912865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.912768    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.912865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.912799    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.912865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.912812    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.912865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.912823    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkk7d\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-kube-api-access-xkk7d\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.912865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.912838    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2336d4f2-50c4-4de5-b009-8b980457b2a8-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:49.912865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:49.912850    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2336d4f2-50c4-4de5-b009-8b980457b2a8-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:50.435585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.435552    2581 generic.go:356] "Generic (PLEG): container finished" podID="2336d4f2-50c4-4de5-b009-8b980457b2a8" containerID="7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba" exitCode=0
Jul 07 23:37:50.436091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.435599    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"
Jul 07 23:37:50.436091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.435642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv" event={"ID":"2336d4f2-50c4-4de5-b009-8b980457b2a8","Type":"ContainerDied","Data":"7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba"}
Jul 07 23:37:50.436091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.435705    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv" event={"ID":"2336d4f2-50c4-4de5-b009-8b980457b2a8","Type":"ContainerDied","Data":"63b9d77b2e5433f6eaa26c18377bc6fa84fce3b192b00506b47e58dc256da950"}
Jul 07 23:37:50.436091 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.435743    2581 scope.go:117] "RemoveContainer" containerID="7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba"
Jul 07 23:37:50.441468 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.441439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn" event={"ID":"ec6fe967-18dd-4d01-a540-88ff5473a67f","Type":"ContainerStarted","Data":"88ce18febd2efb1fcbc0385ccc054f89a981d9e516d22473f4e5a7f2762f4b4b"}
Jul 07 23:37:50.441594 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.441493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn" event={"ID":"ec6fe967-18dd-4d01-a540-88ff5473a67f","Type":"ContainerStarted","Data":"f4fa06b7f6072e005aea5adfc797b77e320d3d3c465232c77ef27bff31276071"}
Jul 07 23:37:50.449517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.449499    2581 scope.go:117] "RemoveContainer" containerID="7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba"
Jul 07 23:37:50.449757 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:37:50.449739    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba\": container with ID starting with 7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba not found: ID does not exist" containerID="7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba"
Jul 07 23:37:50.449813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.449765    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba"} err="failed to get container status \"7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba\": rpc error: code = NotFound desc = could not find container \"7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba\": container with ID starting with 7c48b0d2a631f570b0eb9af1181a56cba6971188f527c51712ca521c3ade5bba not found: ID does not exist"
Jul 07 23:37:50.461184 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.461145    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn" podStartSLOduration=1.461130826 podStartE2EDuration="1.461130826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:37:50.459845428 +0000 UTC m=+1601.679829527" watchObservedRunningTime="2026-07-07 23:37:50.461130826 +0000 UTC m=+1601.681114905"
Jul 07 23:37:50.475231 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.475208    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"]
Jul 07 23:37:50.479728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.479705    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-59ab92de-openshift-default-599899bdfc-shppv"]
Jul 07 23:37:50.641513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.641478    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:50.646823 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.646796    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:50.783483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.783402    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"]
Jul 07 23:37:50.784076 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.784061    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2336d4f2-50c4-4de5-b009-8b980457b2a8" containerName="istio-proxy"
Jul 07 23:37:50.784153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.784080    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2336d4f2-50c4-4de5-b009-8b980457b2a8" containerName="istio-proxy"
Jul 07 23:37:50.784238 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.784226    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2336d4f2-50c4-4de5-b009-8b980457b2a8" containerName="istio-proxy"
Jul 07 23:37:50.788183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.788162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.790798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.790780    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-127adb5c-serving-cert\""
Jul 07 23:37:50.797847 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.797823    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"]
Jul 07 23:37:50.822739 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.822713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.822912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.822792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2pt\" (UniqueName: \"kubernetes.io/projected/78da8f00-e0e0-437e-9471-fb674896b070-kube-api-access-xd2pt\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.822912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.822817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da8f00-e0e0-437e-9471-fb674896b070-openshift-service-ca\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.923750 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.923706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2pt\" (UniqueName: \"kubernetes.io/projected/78da8f00-e0e0-437e-9471-fb674896b070-kube-api-access-xd2pt\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.923908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.923764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da8f00-e0e0-437e-9471-fb674896b070-openshift-service-ca\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.923908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.923818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.923999 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:37:50.923938    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-serving-cert: secret "maas-api-e2e-migrate-127adb5c-serving-cert" not found
Jul 07 23:37:50.923999 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:37:50.923994    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls podName:78da8f00-e0e0-437e-9471-fb674896b070 nodeName:}" failed. No retries permitted until 2026-07-07 23:37:51.42397629 +0000 UTC m=+1602.643960372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls") pod "maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4" (UID: "78da8f00-e0e0-437e-9471-fb674896b070") : secret "maas-api-e2e-migrate-127adb5c-serving-cert" not found
Jul 07 23:37:50.924608 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.924587    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da8f00-e0e0-437e-9471-fb674896b070-openshift-service-ca\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:50.932340 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:50.932319    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2pt\" (UniqueName: \"kubernetes.io/projected/78da8f00-e0e0-437e-9471-fb674896b070-kube-api-access-xd2pt\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:51.429459 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:51.429414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:51.431963 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:51.431938    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls\") pod \"maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:51.448461 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:51.448432    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:51.449326 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:51.449310    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:37:51.505932 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:51.505902    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2336d4f2-50c4-4de5-b009-8b980457b2a8" path="/var/lib/kubelet/pods/2336d4f2-50c4-4de5-b009-8b980457b2a8/volumes"
Jul 07 23:37:51.700343 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:51.700250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:51.845670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:51.845640    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"]
Jul 07 23:37:51.847242 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:37:51.847213    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78da8f00_e0e0_437e_9471_fb674896b070.slice/crio-f0a71bdf0fed063904c65c7de61d2304f6c497ceff1ca742e688f76e033bfb4b WatchSource:0}: Error finding container f0a71bdf0fed063904c65c7de61d2304f6c497ceff1ca742e688f76e033bfb4b: Status 404 returned error can't find the container with id f0a71bdf0fed063904c65c7de61d2304f6c497ceff1ca742e688f76e033bfb4b
Jul 07 23:37:52.455924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:52.455829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4" event={"ID":"78da8f00-e0e0-437e-9471-fb674896b070","Type":"ContainerStarted","Data":"b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379"}
Jul 07 23:37:52.455924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:52.455885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4" event={"ID":"78da8f00-e0e0-437e-9471-fb674896b070","Type":"ContainerStarted","Data":"f0a71bdf0fed063904c65c7de61d2304f6c497ceff1ca742e688f76e033bfb4b"}
Jul 07 23:37:52.456407 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:52.456114    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:52.475200 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:52.475150    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4" podStartSLOduration=2.13453921 podStartE2EDuration="2.475134128s" totalImagesPullingTime="340.594918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:37:52.472021473 +0000 UTC m=+1603.692005562" watchObservedRunningTime="2026-07-07 23:37:52.475134128 +0000 UTC m=+1603.695118278"
Jul 07 23:37:55.335173 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.335140    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"]
Jul 07 23:37:55.335634 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.335366    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn" podUID="ec6fe967-18dd-4d01-a540-88ff5473a67f" containerName="istio-proxy" containerID="cri-o://88ce18febd2efb1fcbc0385ccc054f89a981d9e516d22473f4e5a7f2762f4b4b" gracePeriod=30
Jul 07 23:37:55.601932 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.601837    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"]
Jul 07 23:37:55.602135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.602021    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4" podUID="78da8f00-e0e0-437e-9471-fb674896b070" containerName="maas-api" containerID="cri-o://b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379" gracePeriod=30
Jul 07 23:37:55.897611 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.897589    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:55.972818 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.972789    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da8f00-e0e0-437e-9471-fb674896b070-openshift-service-ca\") pod \"78da8f00-e0e0-437e-9471-fb674896b070\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") "
Jul 07 23:37:55.972995 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.972855    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls\") pod \"78da8f00-e0e0-437e-9471-fb674896b070\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") "
Jul 07 23:37:55.972995 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.972909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd2pt\" (UniqueName: \"kubernetes.io/projected/78da8f00-e0e0-437e-9471-fb674896b070-kube-api-access-xd2pt\") pod \"78da8f00-e0e0-437e-9471-fb674896b070\" (UID: \"78da8f00-e0e0-437e-9471-fb674896b070\") "
Jul 07 23:37:55.973177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.973153    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78da8f00-e0e0-437e-9471-fb674896b070-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78da8f00-e0e0-437e-9471-fb674896b070" (UID: "78da8f00-e0e0-437e-9471-fb674896b070"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:37:55.975015 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.974989    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78da8f00-e0e0-437e-9471-fb674896b070" (UID: "78da8f00-e0e0-437e-9471-fb674896b070"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:37:55.975015 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:55.975001    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78da8f00-e0e0-437e-9471-fb674896b070-kube-api-access-xd2pt" (OuterVolumeSpecName: "kube-api-access-xd2pt") pod "78da8f00-e0e0-437e-9471-fb674896b070" (UID: "78da8f00-e0e0-437e-9471-fb674896b070"). InnerVolumeSpecName "kube-api-access-xd2pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:37:56.074153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.074120    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da8f00-e0e0-437e-9471-fb674896b070-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:56.074153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.074151    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da8f00-e0e0-437e-9471-fb674896b070-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:56.074153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.074160    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd2pt\" (UniqueName: \"kubernetes.io/projected/78da8f00-e0e0-437e-9471-fb674896b070-kube-api-access-xd2pt\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:37:56.481223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.481189    2581 generic.go:356] "Generic (PLEG): container finished" podID="78da8f00-e0e0-437e-9471-fb674896b070" containerID="b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379" exitCode=0
Jul 07 23:37:56.481658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.481230    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"
Jul 07 23:37:56.481658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.481237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4" event={"ID":"78da8f00-e0e0-437e-9471-fb674896b070","Type":"ContainerDied","Data":"b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379"}
Jul 07 23:37:56.481658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.481283    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4" event={"ID":"78da8f00-e0e0-437e-9471-fb674896b070","Type":"ContainerDied","Data":"f0a71bdf0fed063904c65c7de61d2304f6c497ceff1ca742e688f76e033bfb4b"}
Jul 07 23:37:56.481658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.481304    2581 scope.go:117] "RemoveContainer" containerID="b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379"
Jul 07 23:37:56.491083 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.491065    2581 scope.go:117] "RemoveContainer" containerID="b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379"
Jul 07 23:37:56.491376 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:37:56.491357    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379\": container with ID starting with b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379 not found: ID does not exist" containerID="b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379"
Jul 07 23:37:56.491434 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.491384    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379"} err="failed to get container status \"b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379\": rpc error: code = NotFound desc = could not find container \"b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379\": container with ID starting with b0a6c306df39c54946ca3e8a97e45c381f72cfa8074122228b81f488d9d20379 not found: ID does not exist"
Jul 07 23:37:56.503699 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.503680    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"]
Jul 07 23:37:56.511264 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:56.511236    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-127adb5c-dd5868d5b-smsw4"]
Jul 07 23:37:57.502454 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:37:57.502418    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78da8f00-e0e0-437e-9471-fb674896b070" path="/var/lib/kubelet/pods/78da8f00-e0e0-437e-9471-fb674896b070/volumes"
Jul 07 23:38:00.508076 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.508037    2581 generic.go:356] "Generic (PLEG): container finished" podID="ec6fe967-18dd-4d01-a540-88ff5473a67f" containerID="88ce18febd2efb1fcbc0385ccc054f89a981d9e516d22473f4e5a7f2762f4b4b" exitCode=0
Jul 07 23:38:00.508514 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.508242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn" event={"ID":"ec6fe967-18dd-4d01-a540-88ff5473a67f","Type":"ContainerDied","Data":"88ce18febd2efb1fcbc0385ccc054f89a981d9e516d22473f4e5a7f2762f4b4b"}
Jul 07 23:38:00.601430 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.601361    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:38:00.716250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716218    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-data\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716250 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716254    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-credential-socket\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-envoy\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716302    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v85hx\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-kube-api-access-v85hx\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716347    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-certs\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716395    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-podinfo\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-token\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716462    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-socket\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716520    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6fe967-18dd-4d01-a540-88ff5473a67f-istiod-ca-cert\") pod \"ec6fe967-18dd-4d01-a540-88ff5473a67f\" (UID: \"ec6fe967-18dd-4d01-a540-88ff5473a67f\") "
Jul 07 23:38:00.716801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716554    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:00.716801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716677    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:00.716971 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716857    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.716971 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716877    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.716971 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716900    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:00.717168 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.716980    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec6fe967-18dd-4d01-a540-88ff5473a67f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:38:00.718035 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.717214    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:00.718998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.718964    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:00.719163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.719011    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:00.719769 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.719743    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:38:00.719769 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.719748    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-kube-api-access-v85hx" (OuterVolumeSpecName: "kube-api-access-v85hx") pod "ec6fe967-18dd-4d01-a540-88ff5473a67f" (UID: "ec6fe967-18dd-4d01-a540-88ff5473a67f"). InnerVolumeSpecName "kube-api-access-v85hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:00.817692 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.817656    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6fe967-18dd-4d01-a540-88ff5473a67f-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.817692 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.817687    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.817692 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.817696    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.817929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.817704    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v85hx\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-kube-api-access-v85hx\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.817929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.817714    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.817929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.817722    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6fe967-18dd-4d01-a540-88ff5473a67f-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:00.817929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:00.817730    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6fe967-18dd-4d01-a540-88ff5473a67f-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:01.290702 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.290672    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"]
Jul 07 23:38:01.291218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.291194    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78da8f00-e0e0-437e-9471-fb674896b070" containerName="maas-api"
Jul 07 23:38:01.291218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.291217    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78da8f00-e0e0-437e-9471-fb674896b070" containerName="maas-api"
Jul 07 23:38:01.291391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.291262    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6fe967-18dd-4d01-a540-88ff5473a67f" containerName="istio-proxy"
Jul 07 23:38:01.291391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.291271    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6fe967-18dd-4d01-a540-88ff5473a67f" containerName="istio-proxy"
Jul 07 23:38:01.291391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.291367    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6fe967-18dd-4d01-a540-88ff5473a67f" containerName="istio-proxy"
Jul 07 23:38:01.291391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.291380    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78da8f00-e0e0-437e-9471-fb674896b070" containerName="maas-api"
Jul 07 23:38:01.294007 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.293990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.323950 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.297085    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e4be68a6-openshift-default-dockercfg-nfp88\""
Jul 07 23:38:01.323950 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.311943    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"]
Jul 07 23:38:01.423651 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-data\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.423901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361b6907-a11a-4ab9-9796-66ff7111fc9a-istiod-ca-cert\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.423901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-token\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.423901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-podinfo\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.423901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-credential-socket\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.423901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-certs\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.424195 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-socket\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.424195 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-envoy\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.424195 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.423993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt29v\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-kube-api-access-qt29v\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.515600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.515575    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"
Jul 07 23:38:01.515932 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.515611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn" event={"ID":"ec6fe967-18dd-4d01-a540-88ff5473a67f","Type":"ContainerDied","Data":"f4fa06b7f6072e005aea5adfc797b77e320d3d3c465232c77ef27bff31276071"}
Jul 07 23:38:01.515932 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.515659    2581 scope.go:117] "RemoveContainer" containerID="88ce18febd2efb1fcbc0385ccc054f89a981d9e516d22473f4e5a7f2762f4b4b"
Jul 07 23:38:01.524671 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-data\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361b6907-a11a-4ab9-9796-66ff7111fc9a-istiod-ca-cert\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-token\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-podinfo\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-credential-socket\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-certs\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-socket\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-envoy\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.524967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.524947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt29v\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-kube-api-access-qt29v\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.525613 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.525042    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-data\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.525613 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.525374    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-credential-socket\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.525613 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.525495    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-certs\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.525613 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.525542    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-socket\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.526024 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.525999    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361b6907-a11a-4ab9-9796-66ff7111fc9a-istiod-ca-cert\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.528088 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.528068    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-envoy\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.528348 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.528326    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-podinfo\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.535805 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.535766    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-token\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.535912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.535821    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt29v\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-kube-api-access-qt29v\") pod \"e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") " pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.536153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.536129    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"]
Jul 07 23:38:01.539006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.538982    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-127adb5c-gw-openshift-default-644fbd8cc9-kvpcn"]
Jul 07 23:38:01.606677 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.606604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:01.760416 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.760388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"]
Jul 07 23:38:01.761646 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:38:01.761624    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361b6907_a11a_4ab9_9796_66ff7111fc9a.slice/crio-48d3b5bbfba0a4395f41af85fbeb882413d3ae0c3973c6a70234fca3299dbb61 WatchSource:0}: Error finding container 48d3b5bbfba0a4395f41af85fbeb882413d3ae0c3973c6a70234fca3299dbb61: Status 404 returned error can't find the container with id 48d3b5bbfba0a4395f41af85fbeb882413d3ae0c3973c6a70234fca3299dbb61
Jul 07 23:38:01.764208 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.764175    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:01.764296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.764244    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:01.764296 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:01.764271    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:02.513025 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.512992    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"]
Jul 07 23:38:02.516820 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.516799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.519570 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.519546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e4be68a6-serving-cert\""
Jul 07 23:38:02.525513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.525424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" event={"ID":"361b6907-a11a-4ab9-9796-66ff7111fc9a","Type":"ContainerStarted","Data":"4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956"}
Jul 07 23:38:02.525513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.525481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" event={"ID":"361b6907-a11a-4ab9-9796-66ff7111fc9a","Type":"ContainerStarted","Data":"48d3b5bbfba0a4395f41af85fbeb882413d3ae0c3973c6a70234fca3299dbb61"}
Jul 07 23:38:02.531894 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.530122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"]
Jul 07 23:38:02.563208 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.563162    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" podStartSLOduration=1.5631475400000001 podStartE2EDuration="1.56314754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:38:02.560935312 +0000 UTC m=+1613.780919414" watchObservedRunningTime="2026-07-07 23:38:02.56314754 +0000 UTC m=+1613.783131629"
Jul 07 23:38:02.606982 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.606948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:02.611838 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.611815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:02.639683 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.639645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.639846 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.639784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrq69\" (UniqueName: \"kubernetes.io/projected/2de38299-d52f-44b9-8419-ab526ff78f59-kube-api-access-jrq69\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.639846 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.639834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2de38299-d52f-44b9-8419-ab526ff78f59-openshift-service-ca\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.741004 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.740972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2de38299-d52f-44b9-8419-ab526ff78f59-openshift-service-ca\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.741232 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.741076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.741232 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.741179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrq69\" (UniqueName: \"kubernetes.io/projected/2de38299-d52f-44b9-8419-ab526ff78f59-kube-api-access-jrq69\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.741232 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:38:02.741217    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-serving-cert: secret "maas-api-e2e-ait-e4be68a6-serving-cert" not found
Jul 07 23:38:02.741407 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:38:02.741280    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls podName:2de38299-d52f-44b9-8419-ab526ff78f59 nodeName:}" failed. No retries permitted until 2026-07-07 23:38:03.241264264 +0000 UTC m=+1614.461248331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls") pod "maas-api-e2e-ait-e4be68a6-74558694f-b9t8g" (UID: "2de38299-d52f-44b9-8419-ab526ff78f59") : secret "maas-api-e2e-ait-e4be68a6-serving-cert" not found
Jul 07 23:38:02.741588 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.741568    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2de38299-d52f-44b9-8419-ab526ff78f59-openshift-service-ca\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:02.751210 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:02.751187    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrq69\" (UniqueName: \"kubernetes.io/projected/2de38299-d52f-44b9-8419-ab526ff78f59-kube-api-access-jrq69\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:03.246574 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:03.246531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:03.249036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:03.249003    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls\") pod \"maas-api-e2e-ait-e4be68a6-74558694f-b9t8g\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:03.431456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:03.431417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:03.505976 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:03.505894    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6fe967-18dd-4d01-a540-88ff5473a67f" path="/var/lib/kubelet/pods/ec6fe967-18dd-4d01-a540-88ff5473a67f/volumes"
Jul 07 23:38:03.534642 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:03.534571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:03.535762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:03.535715    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:03.589234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:03.589193    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"]
Jul 07 23:38:03.592754 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:38:03.592726    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de38299_d52f_44b9_8419_ab526ff78f59.slice/crio-6abc4977838b6819722e80a6df6a06f708f38db52ba169acbffb5dc789d2c803 WatchSource:0}: Error finding container 6abc4977838b6819722e80a6df6a06f708f38db52ba169acbffb5dc789d2c803: Status 404 returned error can't find the container with id 6abc4977838b6819722e80a6df6a06f708f38db52ba169acbffb5dc789d2c803
Jul 07 23:38:04.542502 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:04.542472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g" event={"ID":"2de38299-d52f-44b9-8419-ab526ff78f59","Type":"ContainerStarted","Data":"3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd"}
Jul 07 23:38:04.542923 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:04.542519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g" event={"ID":"2de38299-d52f-44b9-8419-ab526ff78f59","Type":"ContainerStarted","Data":"6abc4977838b6819722e80a6df6a06f708f38db52ba169acbffb5dc789d2c803"}
Jul 07 23:38:04.542923 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:04.542569    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:04.559692 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:04.559636    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g" podStartSLOduration=2.151180756 podStartE2EDuration="2.559617351s" totalImagesPullingTime="408.436595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:38:04.558780739 +0000 UTC m=+1615.778764829" watchObservedRunningTime="2026-07-07 23:38:04.559617351 +0000 UTC m=+1615.779601441"
Jul 07 23:38:08.071752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.071718    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"]
Jul 07 23:38:08.072274 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.072001    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g" podUID="2de38299-d52f-44b9-8419-ab526ff78f59" containerName="maas-api" containerID="cri-o://3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd" gracePeriod=30
Jul 07 23:38:08.373344 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.373318    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:08.498760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.498732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrq69\" (UniqueName: \"kubernetes.io/projected/2de38299-d52f-44b9-8419-ab526ff78f59-kube-api-access-jrq69\") pod \"2de38299-d52f-44b9-8419-ab526ff78f59\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") "
Jul 07 23:38:08.498933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.498780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls\") pod \"2de38299-d52f-44b9-8419-ab526ff78f59\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") "
Jul 07 23:38:08.498933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.498837    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2de38299-d52f-44b9-8419-ab526ff78f59-openshift-service-ca\") pod \"2de38299-d52f-44b9-8419-ab526ff78f59\" (UID: \"2de38299-d52f-44b9-8419-ab526ff78f59\") "
Jul 07 23:38:08.499245 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.499217    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de38299-d52f-44b9-8419-ab526ff78f59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2de38299-d52f-44b9-8419-ab526ff78f59" (UID: "2de38299-d52f-44b9-8419-ab526ff78f59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:38:08.500831 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.500806    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2de38299-d52f-44b9-8419-ab526ff78f59" (UID: "2de38299-d52f-44b9-8419-ab526ff78f59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:38:08.500831 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.500811    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de38299-d52f-44b9-8419-ab526ff78f59-kube-api-access-jrq69" (OuterVolumeSpecName: "kube-api-access-jrq69") pod "2de38299-d52f-44b9-8419-ab526ff78f59" (UID: "2de38299-d52f-44b9-8419-ab526ff78f59"). InnerVolumeSpecName "kube-api-access-jrq69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:08.570272 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.570241    2581 generic.go:356] "Generic (PLEG): container finished" podID="2de38299-d52f-44b9-8419-ab526ff78f59" containerID="3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd" exitCode=0
Jul 07 23:38:08.570438 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.570306    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"
Jul 07 23:38:08.570438 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.570323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g" event={"ID":"2de38299-d52f-44b9-8419-ab526ff78f59","Type":"ContainerDied","Data":"3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd"}
Jul 07 23:38:08.570438 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.570382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g" event={"ID":"2de38299-d52f-44b9-8419-ab526ff78f59","Type":"ContainerDied","Data":"6abc4977838b6819722e80a6df6a06f708f38db52ba169acbffb5dc789d2c803"}
Jul 07 23:38:08.570438 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.570405    2581 scope.go:117] "RemoveContainer" containerID="3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd"
Jul 07 23:38:08.580493 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.580475    2581 scope.go:117] "RemoveContainer" containerID="3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd"
Jul 07 23:38:08.580763 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:38:08.580744    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd\": container with ID starting with 3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd not found: ID does not exist" containerID="3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd"
Jul 07 23:38:08.580821 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.580771    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd"} err="failed to get container status \"3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd\": rpc error: code = NotFound desc = could not find container \"3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd\": container with ID starting with 3cdb4cbfb96e463b52f942d5abd4b61add721ad9eca6d001a315e103d79761fd not found: ID does not exist"
Jul 07 23:38:08.592510 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.592489    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"]
Jul 07 23:38:08.599732 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.599710    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrq69\" (UniqueName: \"kubernetes.io/projected/2de38299-d52f-44b9-8419-ab526ff78f59-kube-api-access-jrq69\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:08.599732 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.599733    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2de38299-d52f-44b9-8419-ab526ff78f59-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:08.599909 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.599748    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2de38299-d52f-44b9-8419-ab526ff78f59-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:08.599975 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:08.599906    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4be68a6-74558694f-b9t8g"]
Jul 07 23:38:09.505025 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:09.504996    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2de38299-d52f-44b9-8419-ab526ff78f59" path="/var/lib/kubelet/pods/2de38299-d52f-44b9-8419-ab526ff78f59/volumes"
Jul 07 23:38:13.603849 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:13.603816    2581 generic.go:356] "Generic (PLEG): container finished" podID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerID="4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956" exitCode=0
Jul 07 23:38:13.604329 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:13.603889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" event={"ID":"361b6907-a11a-4ab9-9796-66ff7111fc9a","Type":"ContainerDied","Data":"4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956"}
Jul 07 23:38:13.604329 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:13.604300    2581 scope.go:117] "RemoveContainer" containerID="4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956"
Jul 07 23:38:13.605269 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:13.605241    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:13.605391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:13.605323    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:13.605391 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:13.605372    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:13.757312 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:13.757280    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"]
Jul 07 23:38:14.611997 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:14.611956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" event={"ID":"361b6907-a11a-4ab9-9796-66ff7111fc9a","Type":"ContainerStarted","Data":"8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a"}
Jul 07 23:38:14.611997 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:14.611987    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerName="istio-proxy" containerID="cri-o://8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a" gracePeriod=30
Jul 07 23:38:18.534781 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:18.534750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:19.640896 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.640864    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"]
Jul 07 23:38:19.642119 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.642083    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de38299-d52f-44b9-8419-ab526ff78f59" containerName="maas-api"
Jul 07 23:38:19.642248 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.642235    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de38299-d52f-44b9-8419-ab526ff78f59" containerName="maas-api"
Jul 07 23:38:19.642472 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.642454    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de38299-d52f-44b9-8419-ab526ff78f59" containerName="maas-api"
Jul 07 23:38:19.646054 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.646035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.648472 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.648453    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-320aed72-openshift-default-dockercfg-wplg6\""
Jul 07 23:38:19.654895 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.654872    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"]
Jul 07 23:38:19.805763 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.805717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-podinfo\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.805934 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.805805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-certs\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.805934 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.805837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-socket\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.805934 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.805861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-credential-socket\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.805934 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.805888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-data\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.806179 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.805969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istiod-ca-cert\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.806179 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.806070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62wqx\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-kube-api-access-62wqx\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.806179 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.806128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-envoy\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.806179 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.806159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-token\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.881087 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.881026    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:19.907233 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-certs\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-socket\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-credential-socket\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-data\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907575 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istiod-ca-cert\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907575 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62wqx\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-kube-api-access-62wqx\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-envoy\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907610    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-certs\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-token\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907643    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-socket\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-podinfo\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907763    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-data\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.907903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.907698    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-credential-socket\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.908276 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.908254    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istiod-ca-cert\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.909888 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.909869    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-envoy\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.910493 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.910473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-podinfo\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.915713 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.915682    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-token\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.915799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.915750    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62wqx\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-kube-api-access-62wqx\") pod \"e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") " pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:19.993516 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:19.993469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:20.008655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008629    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-credential-socket\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.008759 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361b6907-a11a-4ab9-9796-66ff7111fc9a-istiod-ca-cert\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.008759 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008721    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-data\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.008759 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008747    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-podinfo\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.008871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008828    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-token\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.008871 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-envoy\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.008970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt29v\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-kube-api-access-qt29v\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.008970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.008914    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:20.009153 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.009119    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361b6907-a11a-4ab9-9796-66ff7111fc9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:38:20.009421 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.009249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-certs\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.009421 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.009334    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-socket\") pod \"361b6907-a11a-4ab9-9796-66ff7111fc9a\" (UID: \"361b6907-a11a-4ab9-9796-66ff7111fc9a\") "
Jul 07 23:38:20.009598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.009466    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:20.009598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.009540    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:20.009598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.009591    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:20.010173 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.010149    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.010279 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.010176    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.010279 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.010190    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.010279 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.010204    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361b6907-a11a-4ab9-9796-66ff7111fc9a-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.010279 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.010218    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.011310 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.011286    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:20.011399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.011328    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-kube-api-access-qt29v" (OuterVolumeSpecName: "kube-api-access-qt29v") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "kube-api-access-qt29v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:20.011399 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.011394    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:38:20.011490 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.011402    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "361b6907-a11a-4ab9-9796-66ff7111fc9a" (UID: "361b6907-a11a-4ab9-9796-66ff7111fc9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:20.111698 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.111665    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.111698 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.111696    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.111698 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.111705    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361b6907-a11a-4ab9-9796-66ff7111fc9a-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.111994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.111713    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt29v\" (UniqueName: \"kubernetes.io/projected/361b6907-a11a-4ab9-9796-66ff7111fc9a-kube-api-access-qt29v\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:20.138223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.138199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"]
Jul 07 23:38:20.139259 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:38:20.139238    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcccf2d0c_b564_412d_9b89_27e4e42aab5f.slice/crio-3bbe0cadc3f88f05d3470d780422b8638c5c35c2ca26e533edc38b28ae3199f0 WatchSource:0}: Error finding container 3bbe0cadc3f88f05d3470d780422b8638c5c35c2ca26e533edc38b28ae3199f0: Status 404 returned error can't find the container with id 3bbe0cadc3f88f05d3470d780422b8638c5c35c2ca26e533edc38b28ae3199f0
Jul 07 23:38:20.141366 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.141326    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:20.141433 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.141398    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:20.141433 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.141426    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:38:20.651609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.651578    2581 generic.go:356] "Generic (PLEG): container finished" podID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerID="8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a" exitCode=0
Jul 07 23:38:20.652061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.651625    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"
Jul 07 23:38:20.652061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.651667    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" event={"ID":"361b6907-a11a-4ab9-9796-66ff7111fc9a","Type":"ContainerDied","Data":"8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a"}
Jul 07 23:38:20.652061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.651730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9" event={"ID":"361b6907-a11a-4ab9-9796-66ff7111fc9a","Type":"ContainerDied","Data":"48d3b5bbfba0a4395f41af85fbeb882413d3ae0c3973c6a70234fca3299dbb61"}
Jul 07 23:38:20.652061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.651763    2581 scope.go:117] "RemoveContainer" containerID="8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a"
Jul 07 23:38:20.653553 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.653534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m" event={"ID":"cccf2d0c-b564-412d-9b89-27e4e42aab5f","Type":"ContainerStarted","Data":"ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e"}
Jul 07 23:38:20.653653 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.653581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m" event={"ID":"cccf2d0c-b564-412d-9b89-27e4e42aab5f","Type":"ContainerStarted","Data":"3bbe0cadc3f88f05d3470d780422b8638c5c35c2ca26e533edc38b28ae3199f0"}
Jul 07 23:38:20.666599 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.666575    2581 scope.go:117] "RemoveContainer" containerID="4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956"
Jul 07 23:38:20.674847 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.674824    2581 scope.go:117] "RemoveContainer" containerID="8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a"
Jul 07 23:38:20.675091 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:38:20.675071    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a\": container with ID starting with 8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a not found: ID does not exist" containerID="8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a"
Jul 07 23:38:20.675169 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.675113    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a"} err="failed to get container status \"8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a\": rpc error: code = NotFound desc = could not find container \"8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a\": container with ID starting with 8412a8e63b7b506325a9f888166070d8c53dcaf4df331c50b07691e0fb9b461a not found: ID does not exist"
Jul 07 23:38:20.675169 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.675131    2581 scope.go:117] "RemoveContainer" containerID="4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956"
Jul 07 23:38:20.675341 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:38:20.675326    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956\": container with ID starting with 4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956 not found: ID does not exist" containerID="4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956"
Jul 07 23:38:20.675382 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.675347    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956"} err="failed to get container status \"4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956\": rpc error: code = NotFound desc = could not find container \"4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956\": container with ID starting with 4a17b58a3b73a3ae21ff18e5e3207a3300c241f7552ee07ae6ec0ff353303956 not found: ID does not exist"
Jul 07 23:38:20.676853 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.676800    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m" podStartSLOduration=1.67678553 podStartE2EDuration="1.67678553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:38:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:38:20.676554504 +0000 UTC m=+1631.896538595" watchObservedRunningTime="2026-07-07 23:38:20.67678553 +0000 UTC m=+1631.896769618"
Jul 07 23:38:20.690471 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.690446    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"]
Jul 07 23:38:20.694437 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.694415    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e4be68a6-openshift-default-55956f55bf-lxbn9"]
Jul 07 23:38:20.860059 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.860023    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"]
Jul 07 23:38:20.860766 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.860743    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerName="istio-proxy"
Jul 07 23:38:20.860837 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.860771    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerName="istio-proxy"
Jul 07 23:38:20.860933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.860918    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerName="istio-proxy"
Jul 07 23:38:20.860987 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.860938    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerName="istio-proxy"
Jul 07 23:38:20.865854 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.865833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:20.869236 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.868940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-320aed72-serving-cert\""
Jul 07 23:38:20.872320 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.872084    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"]
Jul 07 23:38:20.993931 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:20.993849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:21.021447 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.021410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpj4p\" (UniqueName: \"kubernetes.io/projected/4c5563e9-b202-4a45-83ff-180fc63eafa9-kube-api-access-bpj4p\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.021633 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.021549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c5563e9-b202-4a45-83ff-180fc63eafa9-openshift-service-ca\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.021689 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.021658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c5563e9-b202-4a45-83ff-180fc63eafa9-maas-api-tls\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.123053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.123016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c5563e9-b202-4a45-83ff-180fc63eafa9-maas-api-tls\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.123247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.123066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpj4p\" (UniqueName: \"kubernetes.io/projected/4c5563e9-b202-4a45-83ff-180fc63eafa9-kube-api-access-bpj4p\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.123247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.123136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c5563e9-b202-4a45-83ff-180fc63eafa9-openshift-service-ca\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.123820 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.123792    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c5563e9-b202-4a45-83ff-180fc63eafa9-openshift-service-ca\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.125782 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.125758    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c5563e9-b202-4a45-83ff-180fc63eafa9-maas-api-tls\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.132254 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.132235    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpj4p\" (UniqueName: \"kubernetes.io/projected/4c5563e9-b202-4a45-83ff-180fc63eafa9-kube-api-access-bpj4p\") pod \"maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.178118 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.178072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:21.320528 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.320504    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"]
Jul 07 23:38:21.321157 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:38:21.321115    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5563e9_b202_4a45_83ff_180fc63eafa9.slice/crio-e63008259f2c4d1598669e53a03df39a19e002ecf5c13b7347fdfcd8ed2cdba6 WatchSource:0}: Error finding container e63008259f2c4d1598669e53a03df39a19e002ecf5c13b7347fdfcd8ed2cdba6: Status 404 returned error can't find the container with id e63008259f2c4d1598669e53a03df39a19e002ecf5c13b7347fdfcd8ed2cdba6
Jul 07 23:38:21.503241 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.503206    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" path="/var/lib/kubelet/pods/361b6907-a11a-4ab9-9796-66ff7111fc9a/volumes"
Jul 07 23:38:21.661649 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.661618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp" event={"ID":"4c5563e9-b202-4a45-83ff-180fc63eafa9","Type":"ContainerStarted","Data":"e63008259f2c4d1598669e53a03df39a19e002ecf5c13b7347fdfcd8ed2cdba6"}
Jul 07 23:38:21.998662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:21.998576    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:22.668559 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:22.668515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp" event={"ID":"4c5563e9-b202-4a45-83ff-180fc63eafa9","Type":"ContainerStarted","Data":"1c11454ab0f41eb7e2bfdd04bc4b3f5fded7523e753a849f9e0c9bc334e3365c"}
Jul 07 23:38:22.668992 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:22.668744    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:22.668992 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:22.668777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:22.669658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:22.669639    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:22.689866 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:22.689819    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp" podStartSLOduration=2.280632143 podStartE2EDuration="2.689806327s" totalImagesPullingTime="409.174184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:38:22.687832259 +0000 UTC m=+1633.907816348" watchObservedRunningTime="2026-07-07 23:38:22.689806327 +0000 UTC m=+1633.909790415"
Jul 07 23:38:25.465571 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.465534    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"]
Jul 07 23:38:25.553469 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.553438    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"]
Jul 07 23:38:25.553837 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.553804    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp" podUID="4c5563e9-b202-4a45-83ff-180fc63eafa9" containerName="maas-api" containerID="cri-o://1c11454ab0f41eb7e2bfdd04bc4b3f5fded7523e753a849f9e0c9bc334e3365c" gracePeriod=30
Jul 07 23:38:25.691375 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.691343    2581 generic.go:356] "Generic (PLEG): container finished" podID="4c5563e9-b202-4a45-83ff-180fc63eafa9" containerID="1c11454ab0f41eb7e2bfdd04bc4b3f5fded7523e753a849f9e0c9bc334e3365c" exitCode=0
Jul 07 23:38:25.691573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.691415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp" event={"ID":"4c5563e9-b202-4a45-83ff-180fc63eafa9","Type":"ContainerDied","Data":"1c11454ab0f41eb7e2bfdd04bc4b3f5fded7523e753a849f9e0c9bc334e3365c"}
Jul 07 23:38:25.691573 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.691508    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m" podUID="cccf2d0c-b564-412d-9b89-27e4e42aab5f" containerName="istio-proxy" containerID="cri-o://ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e" gracePeriod=30
Jul 07 23:38:25.806775 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.806749    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:25.968485 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.968449    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c5563e9-b202-4a45-83ff-180fc63eafa9-maas-api-tls\") pod \"4c5563e9-b202-4a45-83ff-180fc63eafa9\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") "
Jul 07 23:38:25.968654 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.968636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c5563e9-b202-4a45-83ff-180fc63eafa9-openshift-service-ca\") pod \"4c5563e9-b202-4a45-83ff-180fc63eafa9\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") "
Jul 07 23:38:25.968715 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.968672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpj4p\" (UniqueName: \"kubernetes.io/projected/4c5563e9-b202-4a45-83ff-180fc63eafa9-kube-api-access-bpj4p\") pod \"4c5563e9-b202-4a45-83ff-180fc63eafa9\" (UID: \"4c5563e9-b202-4a45-83ff-180fc63eafa9\") "
Jul 07 23:38:25.969014 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.968985    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c5563e9-b202-4a45-83ff-180fc63eafa9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c5563e9-b202-4a45-83ff-180fc63eafa9" (UID: "4c5563e9-b202-4a45-83ff-180fc63eafa9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:38:25.970476 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.970452    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c5563e9-b202-4a45-83ff-180fc63eafa9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c5563e9-b202-4a45-83ff-180fc63eafa9" (UID: "4c5563e9-b202-4a45-83ff-180fc63eafa9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:38:25.970819 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:25.970750    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c5563e9-b202-4a45-83ff-180fc63eafa9-kube-api-access-bpj4p" (OuterVolumeSpecName: "kube-api-access-bpj4p") pod "4c5563e9-b202-4a45-83ff-180fc63eafa9" (UID: "4c5563e9-b202-4a45-83ff-180fc63eafa9"). InnerVolumeSpecName "kube-api-access-bpj4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:26.070440 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.070402    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c5563e9-b202-4a45-83ff-180fc63eafa9-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:26.070440 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.070433    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpj4p\" (UniqueName: \"kubernetes.io/projected/4c5563e9-b202-4a45-83ff-180fc63eafa9-kube-api-access-bpj4p\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:26.070440 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.070444    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c5563e9-b202-4a45-83ff-180fc63eafa9-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:26.699450 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.699420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp" event={"ID":"4c5563e9-b202-4a45-83ff-180fc63eafa9","Type":"ContainerDied","Data":"e63008259f2c4d1598669e53a03df39a19e002ecf5c13b7347fdfcd8ed2cdba6"}
Jul 07 23:38:26.699450 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.699439    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"
Jul 07 23:38:26.699932 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.699482    2581 scope.go:117] "RemoveContainer" containerID="1c11454ab0f41eb7e2bfdd04bc4b3f5fded7523e753a849f9e0c9bc334e3365c"
Jul 07 23:38:26.722267 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.722236    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"]
Jul 07 23:38:26.726687 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:26.726657    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-320aed72-76c69b4f9f-c2rxp"]
Jul 07 23:38:27.503064 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:27.503034    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c5563e9-b202-4a45-83ff-180fc63eafa9" path="/var/lib/kubelet/pods/4c5563e9-b202-4a45-83ff-180fc63eafa9/volumes"
Jul 07 23:38:30.960629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:30.960569    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:31.023981 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.023951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62wqx\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-kube-api-access-62wqx\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.023981 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.023985    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-token\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024014    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-podinfo\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024039    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-data\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024090    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-envoy\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024146    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-socket\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024183    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-certs\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024518 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024258    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-credential-socket\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024518 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024285    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istiod-ca-cert\") pod \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\" (UID: \"cccf2d0c-b564-412d-9b89-27e4e42aab5f\") "
Jul 07 23:38:31.024518 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024408    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-data" (OuterVolumeSpecName: "istio-data") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:31.024675 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024618    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:31.024728 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024687    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.024824 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024779    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:31.024886 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024838    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:31.024947 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.024918    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:38:31.026549 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.026515    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-kube-api-access-62wqx" (OuterVolumeSpecName: "kube-api-access-62wqx") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "kube-api-access-62wqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:31.026840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.026818    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:38:31.027034 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.027013    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-token" (OuterVolumeSpecName: "istio-token") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:38:31.027157 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.027128    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cccf2d0c-b564-412d-9b89-27e4e42aab5f" (UID: "cccf2d0c-b564-412d-9b89-27e4e42aab5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:38:31.125403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125367    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.125403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125392    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.125403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125401    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.125403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125411    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.125747 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125420    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62wqx\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-kube-api-access-62wqx\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.125747 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125428    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.125747 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125436    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.125747 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.125443    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cccf2d0c-b564-412d-9b89-27e4e42aab5f-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:38:31.730648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.730606    2581 generic.go:356] "Generic (PLEG): container finished" podID="cccf2d0c-b564-412d-9b89-27e4e42aab5f" containerID="ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e" exitCode=0
Jul 07 23:38:31.730648 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.730653    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"
Jul 07 23:38:31.730923 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.730718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m" event={"ID":"cccf2d0c-b564-412d-9b89-27e4e42aab5f","Type":"ContainerDied","Data":"ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e"}
Jul 07 23:38:31.730923 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.730759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m" event={"ID":"cccf2d0c-b564-412d-9b89-27e4e42aab5f","Type":"ContainerDied","Data":"3bbe0cadc3f88f05d3470d780422b8638c5c35c2ca26e533edc38b28ae3199f0"}
Jul 07 23:38:31.730923 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.730784    2581 scope.go:117] "RemoveContainer" containerID="ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e"
Jul 07 23:38:31.740280 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.740265    2581 scope.go:117] "RemoveContainer" containerID="ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e"
Jul 07 23:38:31.740538 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:38:31.740511    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e\": container with ID starting with ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e not found: ID does not exist" containerID="ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e"
Jul 07 23:38:31.740586 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.740538    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e"} err="failed to get container status \"ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e\": rpc error: code = NotFound desc = could not find container \"ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e\": container with ID starting with ee268227669295fee1fdff169b26d7a757427945f5dff049ca3a145c13b6796e not found: ID does not exist"
Jul 07 23:38:31.750070 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.750046    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"]
Jul 07 23:38:31.753901 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:31.753881    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-320aed72-openshift-default-fd8d5db67-2lv9m"]
Jul 07 23:38:33.503625 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:38:33.503593    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cccf2d0c-b564-412d-9b89-27e4e42aab5f" path="/var/lib/kubelet/pods/cccf2d0c-b564-412d-9b89-27e4e42aab5f/volumes"
Jul 07 23:40:06.578498 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578419    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"]
Jul 07 23:40:06.578946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578860    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5563e9-b202-4a45-83ff-180fc63eafa9" containerName="maas-api"
Jul 07 23:40:06.578946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578873    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5563e9-b202-4a45-83ff-180fc63eafa9" containerName="maas-api"
Jul 07 23:40:06.578946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578890    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerName="istio-proxy"
Jul 07 23:40:06.578946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578896    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="361b6907-a11a-4ab9-9796-66ff7111fc9a" containerName="istio-proxy"
Jul 07 23:40:06.578946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578909    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cccf2d0c-b564-412d-9b89-27e4e42aab5f" containerName="istio-proxy"
Jul 07 23:40:06.578946 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578914    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cccf2d0c-b564-412d-9b89-27e4e42aab5f" containerName="istio-proxy"
Jul 07 23:40:06.579177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578977    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cccf2d0c-b564-412d-9b89-27e4e42aab5f" containerName="istio-proxy"
Jul 07 23:40:06.579177 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.578985    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c5563e9-b202-4a45-83ff-180fc63eafa9" containerName="maas-api"
Jul 07 23:40:06.582012 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.581996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.584941 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.584920    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 23:40:06.585065 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.584961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-50f7d0aa-openshift-default-dockercfg-svnp6\""
Jul 07 23:40:06.611752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.611719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"]
Jul 07 23:40:06.713196 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-socket\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713196 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-token\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713462 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-envoy\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713462 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-podinfo\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713462 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8f33a-6e3b-4001-a42e-acef886805e9-istiod-ca-cert\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b8v2\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-kube-api-access-4b8v2\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-credential-socket\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-certs\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.713619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.713608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-data\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814092 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-envoy\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814092 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-podinfo\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8f33a-6e3b-4001-a42e-acef886805e9-istiod-ca-cert\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b8v2\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-kube-api-access-4b8v2\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-credential-socket\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-certs\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-data\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-socket\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-token\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814643    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-data\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814675    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-certs\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814763    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-socket\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814966 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-credential-socket\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.814966 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.814910    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8f33a-6e3b-4001-a42e-acef886805e9-istiod-ca-cert\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.816376 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.816353    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-envoy\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.816603 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.816588    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-podinfo\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.822259 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.822236    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b8v2\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-kube-api-access-4b8v2\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.822424 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.822404    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-token\") pod \"e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") " pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:06.892551 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:06.892459    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:07.037763 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.037731    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"]
Jul 07 23:40:07.039160 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:40:07.039135    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e8f33a_6e3b_4001_a42e_acef886805e9.slice/crio-81a7baf261f617e8df81b5e4a60cf201a2d3836e961b2f08cb0ae79144106dc3 WatchSource:0}: Error finding container 81a7baf261f617e8df81b5e4a60cf201a2d3836e961b2f08cb0ae79144106dc3: Status 404 returned error can't find the container with id 81a7baf261f617e8df81b5e4a60cf201a2d3836e961b2f08cb0ae79144106dc3
Jul 07 23:40:07.041334 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.041295    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:07.041398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.041384    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:07.041435 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.041422    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:07.276198 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.276089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" event={"ID":"91e8f33a-6e3b-4001-a42e-acef886805e9","Type":"ContainerStarted","Data":"445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520"}
Jul 07 23:40:07.276198 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.276162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" event={"ID":"91e8f33a-6e3b-4001-a42e-acef886805e9","Type":"ContainerStarted","Data":"81a7baf261f617e8df81b5e4a60cf201a2d3836e961b2f08cb0ae79144106dc3"}
Jul 07 23:40:07.298143 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.298060    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" podStartSLOduration=1.298040107 podStartE2EDuration="1.298040107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:40:07.294961505 +0000 UTC m=+1738.514945608" watchObservedRunningTime="2026-07-07 23:40:07.298040107 +0000 UTC m=+1738.518024199"
Jul 07 23:40:07.892714 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:07.892681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:08.898068 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:08.898038    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:09.287396 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.287320    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:09.288205 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.288189    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:09.451768 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.451735    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"]
Jul 07 23:40:09.455559 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.455536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.459034 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.459009    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-50f7d0aa-serving-cert\""
Jul 07 23:40:09.469470 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.469443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"]
Jul 07 23:40:09.542696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.542672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf9pw\" (UniqueName: \"kubernetes.io/projected/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-kube-api-access-nf9pw\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.542842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.542734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-openshift-service-ca\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.542842 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.542806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.643510 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.643478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.643674 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.643539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf9pw\" (UniqueName: \"kubernetes.io/projected/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-kube-api-access-nf9pw\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.643674 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.643613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-openshift-service-ca\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.643674 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:09.643625    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-serving-cert: secret "maas-api-e2e-mt-50f7d0aa-serving-cert" not found
Jul 07 23:40:09.643851 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:09.643691    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls podName:6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2 nodeName:}" failed. No retries permitted until 2026-07-07 23:40:10.143672726 +0000 UTC m=+1741.363656801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls") pod "maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" (UID: "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2") : secret "maas-api-e2e-mt-50f7d0aa-serving-cert" not found
Jul 07 23:40:09.644252 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.644230    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-openshift-service-ca\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:09.652653 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:09.652633    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf9pw\" (UniqueName: \"kubernetes.io/projected/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-kube-api-access-nf9pw\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:10.148667 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:10.148624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:10.149142 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:10.148771    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-serving-cert: secret "maas-api-e2e-mt-50f7d0aa-serving-cert" not found
Jul 07 23:40:10.149142 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:10.148842    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls podName:6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2 nodeName:}" failed. No retries permitted until 2026-07-07 23:40:11.148823393 +0000 UTC m=+1742.368807467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls") pod "maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" (UID: "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2") : secret "maas-api-e2e-mt-50f7d0aa-serving-cert" not found
Jul 07 23:40:11.159817 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:11.159777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:11.162183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:11.162164    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls\") pod \"maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:11.267196 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:11.267157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:11.408304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:11.408280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"]
Jul 07 23:40:11.409782 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:40:11.409753    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc6b379_3dd8_40a4_bc4f_9b0a101e63b2.slice/crio-889c42c50cf5f2e13c1f1e7ce7139dff0561b6d64299cc0a73221878d65b182d WatchSource:0}: Error finding container 889c42c50cf5f2e13c1f1e7ce7139dff0561b6d64299cc0a73221878d65b182d: Status 404 returned error can't find the container with id 889c42c50cf5f2e13c1f1e7ce7139dff0561b6d64299cc0a73221878d65b182d
Jul 07 23:40:12.307896 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:12.307853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" event={"ID":"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2","Type":"ContainerStarted","Data":"5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318"}
Jul 07 23:40:12.308313 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:12.307918    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" event={"ID":"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2","Type":"ContainerStarted","Data":"889c42c50cf5f2e13c1f1e7ce7139dff0561b6d64299cc0a73221878d65b182d"}
Jul 07 23:40:12.308313 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:12.307948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:12.325619 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:12.325571    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" podStartSLOduration=2.918510847 podStartE2EDuration="3.325556397s" totalImagesPullingTime="407.04555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:40:12.324498886 +0000 UTC m=+1743.544482975" watchObservedRunningTime="2026-07-07 23:40:12.325556397 +0000 UTC m=+1743.545540485"
Jul 07 23:40:18.319370 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:18.319340    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:21.356998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.356966    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"]
Jul 07 23:40:21.357612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.357567    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" podUID="6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" containerName="maas-api" containerID="cri-o://5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318" gracePeriod=30
Jul 07 23:40:21.630354 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.630328    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:21.774682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.774649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls\") pod \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") "
Jul 07 23:40:21.774834 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.774815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf9pw\" (UniqueName: \"kubernetes.io/projected/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-kube-api-access-nf9pw\") pod \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") "
Jul 07 23:40:21.774874 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.774854    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-openshift-service-ca\") pod \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\" (UID: \"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2\") "
Jul 07 23:40:21.775280 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.775248    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" (UID: "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:40:21.776917 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.776882    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-kube-api-access-nf9pw" (OuterVolumeSpecName: "kube-api-access-nf9pw") pod "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" (UID: "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2"). InnerVolumeSpecName "kube-api-access-nf9pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:40:21.777071 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.777048    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" (UID: "6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:40:21.876690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.876600    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf9pw\" (UniqueName: \"kubernetes.io/projected/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-kube-api-access-nf9pw\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:21.876690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.876639    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:21.876690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:21.876652    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:22.384343 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.384299    2581 generic.go:356] "Generic (PLEG): container finished" podID="6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" containerID="5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318" exitCode=0
Jul 07 23:40:22.384343 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.384344    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"
Jul 07 23:40:22.384799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.384364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" event={"ID":"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2","Type":"ContainerDied","Data":"5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318"}
Jul 07 23:40:22.384799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.384421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s" event={"ID":"6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2","Type":"ContainerDied","Data":"889c42c50cf5f2e13c1f1e7ce7139dff0561b6d64299cc0a73221878d65b182d"}
Jul 07 23:40:22.384799 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.384445    2581 scope.go:117] "RemoveContainer" containerID="5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318"
Jul 07 23:40:22.395571 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.395550    2581 scope.go:117] "RemoveContainer" containerID="5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318"
Jul 07 23:40:22.395853 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:22.395834    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318\": container with ID starting with 5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318 not found: ID does not exist" containerID="5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318"
Jul 07 23:40:22.395924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.395861    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318"} err="failed to get container status \"5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318\": rpc error: code = NotFound desc = could not find container \"5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318\": container with ID starting with 5f898b26a58cc0ee8095dbd73a8657c5e21780f4339c2f26ef847ea936223318 not found: ID does not exist"
Jul 07 23:40:22.408378 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.408354    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"]
Jul 07 23:40:22.411435 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:22.411416    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f7d0aa-65f97df6cf-bwc2s"]
Jul 07 23:40:23.503005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:23.502964    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" path="/var/lib/kubelet/pods/6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2/volumes"
Jul 07 23:40:24.289041 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.289008    2581 patch_prober.go:28] interesting pod/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 07 23:40:24.289283 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.289060    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 07 23:40:24.398345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.398312    2581 generic.go:356] "Generic (PLEG): container finished" podID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerID="445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520" exitCode=0
Jul 07 23:40:24.398345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.398349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" event={"ID":"91e8f33a-6e3b-4001-a42e-acef886805e9","Type":"ContainerDied","Data":"445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520"}
Jul 07 23:40:24.398755 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.398742    2581 scope.go:117] "RemoveContainer" containerID="445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520"
Jul 07 23:40:24.399723 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.399690    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:24.399823 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.399775    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:24.399880 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:24.399845    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:25.406337 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:25.406302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" event={"ID":"91e8f33a-6e3b-4001-a42e-acef886805e9","Type":"ContainerStarted","Data":"a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3"}
Jul 07 23:40:25.893298 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:25.893261    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:25.893509 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:25.893490    2581 patch_prober.go:28] interesting pod/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 07 23:40:25.893569 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:25.893536    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 07 23:40:26.893224 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:26.893191    2581 patch_prober.go:28] interesting pod/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 07 23:40:26.893594 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:26.893246    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 07 23:40:27.452564 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:27.452530    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"]
Jul 07 23:40:27.453027 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:27.452996    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy" containerID="cri-o://a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3" gracePeriod=30
Jul 07 23:40:34.413910 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.413887    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:34.469609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.469509    2581 generic.go:356] "Generic (PLEG): container finished" podID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerID="a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3" exitCode=0
Jul 07 23:40:34.469609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.469560    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"
Jul 07 23:40:34.469609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.469587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" event={"ID":"91e8f33a-6e3b-4001-a42e-acef886805e9","Type":"ContainerDied","Data":"a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3"}
Jul 07 23:40:34.469840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.469665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f" event={"ID":"91e8f33a-6e3b-4001-a42e-acef886805e9","Type":"ContainerDied","Data":"81a7baf261f617e8df81b5e4a60cf201a2d3836e961b2f08cb0ae79144106dc3"}
Jul 07 23:40:34.469840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.469689    2581 scope.go:117] "RemoveContainer" containerID="a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3"
Jul 07 23:40:34.478899 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.478883    2581 scope.go:117] "RemoveContainer" containerID="445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520"
Jul 07 23:40:34.487545 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.487531    2581 scope.go:117] "RemoveContainer" containerID="a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3"
Jul 07 23:40:34.487801 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:34.487780    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3\": container with ID starting with a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3 not found: ID does not exist" containerID="a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3"
Jul 07 23:40:34.487905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.487808    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3"} err="failed to get container status \"a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3\": rpc error: code = NotFound desc = could not find container \"a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3\": container with ID starting with a0eb3c543cfe2b6e6d1826561042cdd6ee42df599f4b780f28c818273e8709f3 not found: ID does not exist"
Jul 07 23:40:34.487905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.487826    2581 scope.go:117] "RemoveContainer" containerID="445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520"
Jul 07 23:40:34.488060 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:34.488045    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520\": container with ID starting with 445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520 not found: ID does not exist" containerID="445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520"
Jul 07 23:40:34.488128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.488065    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520"} err="failed to get container status \"445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520\": rpc error: code = NotFound desc = could not find container \"445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520\": container with ID starting with 445f890ff9fcccc4133176ec66d0dc663c4c155abbac0ffb3f21a50c14032520 not found: ID does not exist"
Jul 07 23:40:34.505935 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.505914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-podinfo\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506050 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.505957    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-token\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506050 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.505988    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-envoy\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506050 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506023    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b8v2\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-kube-api-access-4b8v2\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8f33a-6e3b-4001-a42e-acef886805e9-istiod-ca-cert\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-socket\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506178    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-credential-socket\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506380 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-certs\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506380 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506268    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-data\") pod \"91e8f33a-6e3b-4001-a42e-acef886805e9\" (UID: \"91e8f33a-6e3b-4001-a42e-acef886805e9\") "
Jul 07 23:40:34.506478 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506419    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:40:34.506584 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506545    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:40:34.506649 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506634    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.506721 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506699    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:40:34.506813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.506791    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91e8f33a-6e3b-4001-a42e-acef886805e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:40:34.507488 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.507457    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:40:34.508332 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.508312    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:40:34.508558 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.508528    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-kube-api-access-4b8v2" (OuterVolumeSpecName: "kube-api-access-4b8v2") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "kube-api-access-4b8v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:40:34.508643 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.508585    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:40:34.508643 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.508596    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "91e8f33a-6e3b-4001-a42e-acef886805e9" (UID: "91e8f33a-6e3b-4001-a42e-acef886805e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:40:34.607576 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607540    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.607576 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607572    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.607798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607586    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b8v2\" (UniqueName: \"kubernetes.io/projected/91e8f33a-6e3b-4001-a42e-acef886805e9-kube-api-access-4b8v2\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.607798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607600    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91e8f33a-6e3b-4001-a42e-acef886805e9-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.607798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607615    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.607798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607628    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.607798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607641    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.607798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.607655    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91e8f33a-6e3b-4001-a42e-acef886805e9-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:40:34.797479 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.797444    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"]
Jul 07 23:40:34.810059 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:34.810036    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-50f7d0aa-openshift-default-784f8dd8bc-wwr6f"]
Jul 07 23:40:35.503149 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:35.503119    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" path="/var/lib/kubelet/pods/91e8f33a-6e3b-4001-a42e-acef886805e9/volumes"
Jul 07 23:40:46.879328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879296    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"]
Jul 07 23:40:46.879829 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879816    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" containerName="maas-api"
Jul 07 23:40:46.879873 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879830    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" containerName="maas-api"
Jul 07 23:40:46.879873 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879841    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy"
Jul 07 23:40:46.879873 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879847    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy"
Jul 07 23:40:46.879873 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879853    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy"
Jul 07 23:40:46.879873 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879859    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy"
Jul 07 23:40:46.880026 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879931    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy"
Jul 07 23:40:46.880026 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879945    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e8f33a-6e3b-4001-a42e-acef886805e9" containerName="istio-proxy"
Jul 07 23:40:46.880026 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.879956    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc6b379-3dd8-40a4-bc4f-9b0a101e63b2" containerName="maas-api"
Jul 07 23:40:46.882934 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.882915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:46.885542 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.885521    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 23:40:46.885670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.885551    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3d30887b-openshift-default-dockercfg-m5m5r\""
Jul 07 23:40:46.893988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:46.893963    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"]
Jul 07 23:40:47.018756 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6e70a6f-3903-4425-a322-03388685a91a-istiod-ca-cert\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.018930 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-credential-socket\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.018930 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-istio-token\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.018930 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-socket\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.018930 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vw9k\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-kube-api-access-5vw9k\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.018930 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-certs\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.018930 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-envoy\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.019164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-data\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.019164 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.018987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6e70a6f-3903-4425-a322-03388685a91a-istio-podinfo\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6e70a6f-3903-4425-a322-03388685a91a-istiod-ca-cert\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-credential-socket\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-istio-token\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-socket\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vw9k\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-kube-api-access-5vw9k\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-certs\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-envoy\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120572 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-data\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120572 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6e70a6f-3903-4425-a322-03388685a91a-istio-podinfo\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120567    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-socket\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120662 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-credential-socket\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120824 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120799    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-data\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120801    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-certs\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.120937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.120869    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6e70a6f-3903-4425-a322-03388685a91a-istiod-ca-cert\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.122830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.122806    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-envoy\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.122951 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.122930    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6e70a6f-3903-4425-a322-03388685a91a-istio-podinfo\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.129820 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.129769    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-istio-token\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.130451 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.130430    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vw9k\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-kube-api-access-5vw9k\") pod \"e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") " pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.193747 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.193722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:47.338637 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.338612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"]
Jul 07 23:40:47.341323 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:40:47.341293    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e70a6f_3903_4425_a322_03388685a91a.slice/crio-c4de8a8db3bdba12609adcdb1709aa2009dcad416573e9e43237d24162bb5191 WatchSource:0}: Error finding container c4de8a8db3bdba12609adcdb1709aa2009dcad416573e9e43237d24162bb5191: Status 404 returned error can't find the container with id c4de8a8db3bdba12609adcdb1709aa2009dcad416573e9e43237d24162bb5191
Jul 07 23:40:47.343647 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.343604    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:47.343733 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.343703    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:47.343780 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.343750    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:40:47.553586 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.553546    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" event={"ID":"b6e70a6f-3903-4425-a322-03388685a91a","Type":"ContainerStarted","Data":"3c71cac88cdc304dbe814cc43e139cafe43b335c7aa4c8f15c1950eb05bbe0ce"}
Jul 07 23:40:47.553783 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.553618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" event={"ID":"b6e70a6f-3903-4425-a322-03388685a91a","Type":"ContainerStarted","Data":"c4de8a8db3bdba12609adcdb1709aa2009dcad416573e9e43237d24162bb5191"}
Jul 07 23:40:47.580278 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:47.580224    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" podStartSLOduration=1.580203595 podStartE2EDuration="1.580203595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:40:47.576539359 +0000 UTC m=+1778.796523449" watchObservedRunningTime="2026-07-07 23:40:47.580203595 +0000 UTC m=+1778.800187687"
Jul 07 23:40:48.193958 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:48.193927    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:48.199371 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:48.199343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:48.559343 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:48.559309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:48.560231 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:48.560210    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:40:49.578750 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.578712    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"]
Jul 07 23:40:49.582503 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.582479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.585002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.584983    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3d30887b-serving-cert\""
Jul 07 23:40:49.593745 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.593724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"]
Jul 07 23:40:49.646557 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.646523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.646774 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.646752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqdvw\" (UniqueName: \"kubernetes.io/projected/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-kube-api-access-pqdvw\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.646848 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.646800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-openshift-service-ca\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.747477 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.747443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqdvw\" (UniqueName: \"kubernetes.io/projected/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-kube-api-access-pqdvw\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.747477 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.747476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-openshift-service-ca\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.747734 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.747513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.747734 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:49.747632    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-serving-cert: secret "maas-api-e2e-mt-3d30887b-serving-cert" not found
Jul 07 23:40:49.747734 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:40:49.747690    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls podName:72a1bb26-aadc-4ba8-bf34-36f5f28a5697 nodeName:}" failed. No retries permitted until 2026-07-07 23:40:50.247673973 +0000 UTC m=+1781.467658043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls") pod "maas-api-e2e-mt-3d30887b-7768d87876-vnw57" (UID: "72a1bb26-aadc-4ba8-bf34-36f5f28a5697") : secret "maas-api-e2e-mt-3d30887b-serving-cert" not found
Jul 07 23:40:49.748065 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.748047    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-openshift-service-ca\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:49.755890 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:49.755864    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqdvw\" (UniqueName: \"kubernetes.io/projected/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-kube-api-access-pqdvw\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:50.252791 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:50.252756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:50.255187 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:50.255165    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls\") pod \"maas-api-e2e-mt-3d30887b-7768d87876-vnw57\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:50.494201 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:50.494168    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:50.638726 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:50.638702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"]
Jul 07 23:40:50.640824 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:40:50.640796    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a1bb26_aadc_4ba8_bf34_36f5f28a5697.slice/crio-678774c71ec89d485c0961d768a828b78c4de650b60cf75dd7d39e08a5c113b5 WatchSource:0}: Error finding container 678774c71ec89d485c0961d768a828b78c4de650b60cf75dd7d39e08a5c113b5: Status 404 returned error can't find the container with id 678774c71ec89d485c0961d768a828b78c4de650b60cf75dd7d39e08a5c113b5
Jul 07 23:40:51.582740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:51.582705    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57" event={"ID":"72a1bb26-aadc-4ba8-bf34-36f5f28a5697","Type":"ContainerStarted","Data":"65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7"}
Jul 07 23:40:51.582913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:51.582760    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57" event={"ID":"72a1bb26-aadc-4ba8-bf34-36f5f28a5697","Type":"ContainerStarted","Data":"678774c71ec89d485c0961d768a828b78c4de650b60cf75dd7d39e08a5c113b5"}
Jul 07 23:40:51.582913 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:51.582884    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:40:51.602167 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:51.602122    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57" podStartSLOduration=2.206567609 podStartE2EDuration="2.602090403s" totalImagesPullingTime="395.522794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:40:51.599446718 +0000 UTC m=+1782.819430806" watchObservedRunningTime="2026-07-07 23:40:51.602090403 +0000 UTC m=+1782.822074491"
Jul 07 23:40:57.594408 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:40:57.594376    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:41:02.653273 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:02.653233    2581 generic.go:356] "Generic (PLEG): container finished" podID="b6e70a6f-3903-4425-a322-03388685a91a" containerID="3c71cac88cdc304dbe814cc43e139cafe43b335c7aa4c8f15c1950eb05bbe0ce" exitCode=0
Jul 07 23:41:02.653729 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:02.653291    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" event={"ID":"b6e70a6f-3903-4425-a322-03388685a91a","Type":"ContainerDied","Data":"3c71cac88cdc304dbe814cc43e139cafe43b335c7aa4c8f15c1950eb05bbe0ce"}
Jul 07 23:41:02.653729 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:02.653718    2581 scope.go:117] "RemoveContainer" containerID="3c71cac88cdc304dbe814cc43e139cafe43b335c7aa4c8f15c1950eb05bbe0ce"
Jul 07 23:41:02.654786 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:02.654757    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:41:02.654908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:02.654840    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:41:02.654908 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:02.654893    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:41:03.559772 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:03.559732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:41:03.661061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:03.661026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" event={"ID":"b6e70a6f-3903-4425-a322-03388685a91a","Type":"ContainerStarted","Data":"59dcacaba8f57fb553239f55f1ac3ecc85ea72216f3384624ccd9f2dd7c60f84"}
Jul 07 23:41:04.193960 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:04.193927    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:41:04.194756 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:04.194729    2581 patch_prober.go:28] interesting pod/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 07 23:41:04.194894 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:04.194789    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 07 23:41:05.194919 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:05.194887    2581 patch_prober.go:28] interesting pod/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 07 23:41:05.195398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:05.194958    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 07 23:41:06.194072 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:06.194041    2581 patch_prober.go:28] interesting pod/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 07 23:41:06.194271 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:06.194123    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 07 23:41:07.194432 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:07.194397    2581 patch_prober.go:28] interesting pod/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 07 23:41:07.194833 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:07.194453    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 07 23:41:08.197508 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:08.197480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:41:08.197885 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:08.197730    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:41:08.198398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:08.198379    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:41:11.462271 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:11.462247    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:41:11.474670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:11.474649    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:41:42.208740 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.208699    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"]
Jul 07 23:41:42.209235 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.208941    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57" podUID="72a1bb26-aadc-4ba8-bf34-36f5f28a5697" containerName="maas-api" containerID="cri-o://65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7" gracePeriod=30
Jul 07 23:41:42.464151 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.464076    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:41:42.559859 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.559832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-openshift-service-ca\") pod \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") "
Jul 07 23:41:42.560008 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.559891    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls\") pod \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") "
Jul 07 23:41:42.560008 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.559927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqdvw\" (UniqueName: \"kubernetes.io/projected/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-kube-api-access-pqdvw\") pod \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\" (UID: \"72a1bb26-aadc-4ba8-bf34-36f5f28a5697\") "
Jul 07 23:41:42.560262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.560233    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72a1bb26-aadc-4ba8-bf34-36f5f28a5697" (UID: "72a1bb26-aadc-4ba8-bf34-36f5f28a5697"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:41:42.562036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.562013    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-kube-api-access-pqdvw" (OuterVolumeSpecName: "kube-api-access-pqdvw") pod "72a1bb26-aadc-4ba8-bf34-36f5f28a5697" (UID: "72a1bb26-aadc-4ba8-bf34-36f5f28a5697"). InnerVolumeSpecName "kube-api-access-pqdvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:41:42.562160 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.562142    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72a1bb26-aadc-4ba8-bf34-36f5f28a5697" (UID: "72a1bb26-aadc-4ba8-bf34-36f5f28a5697"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:41:42.661247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.661220    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:41:42.661247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.661245    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:41:42.661247 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.661253    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqdvw\" (UniqueName: \"kubernetes.io/projected/72a1bb26-aadc-4ba8-bf34-36f5f28a5697-kube-api-access-pqdvw\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:41:42.888407 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.888366    2581 generic.go:356] "Generic (PLEG): container finished" podID="72a1bb26-aadc-4ba8-bf34-36f5f28a5697" containerID="65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7" exitCode=0
Jul 07 23:41:42.888604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.888414    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"
Jul 07 23:41:42.888604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.888456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57" event={"ID":"72a1bb26-aadc-4ba8-bf34-36f5f28a5697","Type":"ContainerDied","Data":"65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7"}
Jul 07 23:41:42.888604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.888521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57" event={"ID":"72a1bb26-aadc-4ba8-bf34-36f5f28a5697","Type":"ContainerDied","Data":"678774c71ec89d485c0961d768a828b78c4de650b60cf75dd7d39e08a5c113b5"}
Jul 07 23:41:42.888604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.888550    2581 scope.go:117] "RemoveContainer" containerID="65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7"
Jul 07 23:41:42.898775 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.898758    2581 scope.go:117] "RemoveContainer" containerID="65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7"
Jul 07 23:41:42.899035 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:41:42.899017    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7\": container with ID starting with 65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7 not found: ID does not exist" containerID="65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7"
Jul 07 23:41:42.899086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.899044    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7"} err="failed to get container status \"65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7\": rpc error: code = NotFound desc = could not find container \"65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7\": container with ID starting with 65f25b1b1691fd52216a86549e3549d964256152d59c3a76d1570d2bf3af54c7 not found: ID does not exist"
Jul 07 23:41:42.910996 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.910970    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"]
Jul 07 23:41:42.914529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:42.914510    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3d30887b-7768d87876-vnw57"]
Jul 07 23:41:43.503668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:41:43.503636    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a1bb26-aadc-4ba8-bf34-36f5f28a5697" path="/var/lib/kubelet/pods/72a1bb26-aadc-4ba8-bf34-36f5f28a5697/volumes"
Jul 07 23:42:35.028492 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:35.028398    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"]
Jul 07 23:42:35.029061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:35.028644    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy" containerID="cri-o://59dcacaba8f57fb553239f55f1ac3ecc85ea72216f3384624ccd9f2dd7c60f84" gracePeriod=30
Jul 07 23:42:38.200260 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:38.200224    2581 patch_prober.go:28] interesting pod/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 07 23:42:38.200620 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:38.200283    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 23:42:40.214804 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.214773    2581 generic.go:356] "Generic (PLEG): container finished" podID="b6e70a6f-3903-4425-a322-03388685a91a" containerID="59dcacaba8f57fb553239f55f1ac3ecc85ea72216f3384624ccd9f2dd7c60f84" exitCode=0
Jul 07 23:42:40.215229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.214823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" event={"ID":"b6e70a6f-3903-4425-a322-03388685a91a","Type":"ContainerDied","Data":"59dcacaba8f57fb553239f55f1ac3ecc85ea72216f3384624ccd9f2dd7c60f84"}
Jul 07 23:42:40.215229 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.214897    2581 scope.go:117] "RemoveContainer" containerID="3c71cac88cdc304dbe814cc43e139cafe43b335c7aa4c8f15c1950eb05bbe0ce"
Jul 07 23:42:40.293034 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.293009    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:42:40.397812 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.397778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-socket\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.397812 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.397815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-istio-token\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398012 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.397842    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-certs\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398012 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.397890    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-data\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398012 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.397955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vw9k\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-kube-api-access-5vw9k\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398012 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.397986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6e70a6f-3903-4425-a322-03388685a91a-istiod-ca-cert\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398244 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398019    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-credential-socket\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398244 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398047    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-envoy\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398244 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398068    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:42:40.398244 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398153    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6e70a6f-3903-4425-a322-03388685a91a-istio-podinfo\") pod \"b6e70a6f-3903-4425-a322-03388685a91a\" (UID: \"b6e70a6f-3903-4425-a322-03388685a91a\") "
Jul 07 23:42:40.398459 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398276    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:42:40.398459 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398337    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:42:40.398459 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398420    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e70a6f-3903-4425-a322-03388685a91a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:42:40.398621 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398516    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6e70a6f-3903-4425-a322-03388685a91a-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.398621 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398535    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.398621 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398550    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.398621 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398563    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.398957 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.398929    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:42:40.400341 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.400322    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6e70a6f-3903-4425-a322-03388685a91a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:42:40.400428 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.400411    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:42:40.400713 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.400684    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-kube-api-access-5vw9k" (OuterVolumeSpecName: "kube-api-access-5vw9k") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "kube-api-access-5vw9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:42:40.400713 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.400694    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6e70a6f-3903-4425-a322-03388685a91a" (UID: "b6e70a6f-3903-4425-a322-03388685a91a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:42:40.499414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.499381    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6e70a6f-3903-4425-a322-03388685a91a-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.499414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.499407    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.499414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.499420    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.499625 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.499431    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vw9k\" (UniqueName: \"kubernetes.io/projected/b6e70a6f-3903-4425-a322-03388685a91a-kube-api-access-5vw9k\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:40.499625 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:40.499444    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6e70a6f-3903-4425-a322-03388685a91a-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:42:41.222478 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:41.222453    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"
Jul 07 23:42:41.222478 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:41.222455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj" event={"ID":"b6e70a6f-3903-4425-a322-03388685a91a","Type":"ContainerDied","Data":"c4de8a8db3bdba12609adcdb1709aa2009dcad416573e9e43237d24162bb5191"}
Jul 07 23:42:41.222978 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:41.222516    2581 scope.go:117] "RemoveContainer" containerID="59dcacaba8f57fb553239f55f1ac3ecc85ea72216f3384624ccd9f2dd7c60f84"
Jul 07 23:42:41.251114 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:41.251074    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"]
Jul 07 23:42:41.254823 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:41.254799    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3d30887b-openshift-default-54bf5b647-rk2hj"]
Jul 07 23:42:41.503249 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:42:41.503171    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e70a6f-3903-4425-a322-03388685a91a" path="/var/lib/kubelet/pods/b6e70a6f-3903-4425-a322-03388685a91a/volumes"
Jul 07 23:43:29.572791 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.572758    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"]
Jul 07 23:43:29.573304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573239    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy"
Jul 07 23:43:29.573304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573251    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy"
Jul 07 23:43:29.573304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573269    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a1bb26-aadc-4ba8-bf34-36f5f28a5697" containerName="maas-api"
Jul 07 23:43:29.573304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573274    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a1bb26-aadc-4ba8-bf34-36f5f28a5697" containerName="maas-api"
Jul 07 23:43:29.573304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573281    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy"
Jul 07 23:43:29.573304 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573286    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy"
Jul 07 23:43:29.573598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573362    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy"
Jul 07 23:43:29.573598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.573372    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a1bb26-aadc-4ba8-bf34-36f5f28a5697" containerName="maas-api"
Jul 07 23:43:29.576599 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.576580    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.579066 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.579044    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 23:43:29.579279 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.579174    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7ddfc0-openshift-default-dockercfg-qk79w\""
Jul 07 23:43:29.586802 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.586781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"]
Jul 07 23:43:29.641021 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.640994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g7km\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-kube-api-access-4g7km\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641209 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-envoy\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641209 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-certs\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641209 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-credential-socket\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641209 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-istio-token\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c83b61f-62d6-4903-b405-d8c40e976400-istiod-ca-cert\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c83b61f-62d6-4903-b405-d8c40e976400-istio-podinfo\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-socket\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.641445 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.641425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-data\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742744 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c83b61f-62d6-4903-b405-d8c40e976400-istio-podinfo\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742744 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-socket\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-data\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g7km\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-kube-api-access-4g7km\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-envoy\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-certs\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-credential-socket\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-istio-token\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.742991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.742990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c83b61f-62d6-4903-b405-d8c40e976400-istiod-ca-cert\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.743383 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.743196    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-socket\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.743483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.743455    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-data\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.743598 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.743576    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-certs\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.743656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.743626    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-credential-socket\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.743656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.743650    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c83b61f-62d6-4903-b405-d8c40e976400-istiod-ca-cert\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.745382 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.745362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c83b61f-62d6-4903-b405-d8c40e976400-istio-podinfo\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.745486 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.745362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-envoy\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.750568 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.750547    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-istio-token\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.750767 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.750751    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g7km\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-kube-api-access-4g7km\") pod \"e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") " pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:29.887783 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:29.887697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:30.034965 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.034939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"]
Jul 07 23:43:30.036230 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:43:30.036203    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c83b61f_62d6_4903_b405_d8c40e976400.slice/crio-5f6c413692ed1452522fe8c0ff64a2db694c6672e690c816622e837edb7012ed WatchSource:0}: Error finding container 5f6c413692ed1452522fe8c0ff64a2db694c6672e690c816622e837edb7012ed: Status 404 returned error can't find the container with id 5f6c413692ed1452522fe8c0ff64a2db694c6672e690c816622e837edb7012ed
Jul 07 23:43:30.038364 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.038331    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:43:30.038433 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.038396    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:43:30.038433 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.038425    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:43:30.499353 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.499320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" event={"ID":"5c83b61f-62d6-4903-b405-d8c40e976400","Type":"ContainerStarted","Data":"3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3"}
Jul 07 23:43:30.499531 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.499373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" event={"ID":"5c83b61f-62d6-4903-b405-d8c40e976400","Type":"ContainerStarted","Data":"5f6c413692ed1452522fe8c0ff64a2db694c6672e690c816622e837edb7012ed"}
Jul 07 23:43:30.519654 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.519603    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" podStartSLOduration=1.5195883380000001 podStartE2EDuration="1.519588338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:43:30.518264785 +0000 UTC m=+1941.738248875" watchObservedRunningTime="2026-07-07 23:43:30.519588338 +0000 UTC m=+1941.739572427"
Jul 07 23:43:30.888752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:30.888719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:31.893345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:31.893313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:32.510611 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.510583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:32.511493 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.511476    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:32.563299 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.563266    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"]
Jul 07 23:43:32.563892 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.563872    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e70a6f-3903-4425-a322-03388685a91a" containerName="istio-proxy"
Jul 07 23:43:32.567457 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.567442    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.569940 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.569921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7ddfc0-serving-cert\""
Jul 07 23:43:32.576337 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.576141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"]
Jul 07 23:43:32.671942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.671909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwfnz\" (UniqueName: \"kubernetes.io/projected/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-kube-api-access-wwfnz\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.672163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.671957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.672163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.672075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.773604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.773530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.773604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.773592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwfnz\" (UniqueName: \"kubernetes.io/projected/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-kube-api-access-wwfnz\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.773797 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.773622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.773797 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:43:32.773679    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-serving-cert: secret "maas-api-e2e-inf-a-7ddfc0-serving-cert" not found
Jul 07 23:43:32.773797 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:43:32.773749    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls podName:ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e nodeName:}" failed. No retries permitted until 2026-07-07 23:43:33.273731125 +0000 UTC m=+1944.493715214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls") pod "maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7" (UID: "ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e") : secret "maas-api-e2e-inf-a-7ddfc0-serving-cert" not found
Jul 07 23:43:32.774243 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.774227    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:32.783374 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:32.783339    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwfnz\" (UniqueName: \"kubernetes.io/projected/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-kube-api-access-wwfnz\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:33.279262 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:33.279226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:33.281691 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:33.281669    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls\") pod \"maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:33.480221 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:33.480186    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:33.632660 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:33.632626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"]
Jul 07 23:43:33.636530 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:43:33.636502    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab61c90e_2477_4d6a_a7da_ada9a0b7dd7e.slice/crio-5d072a58af72233c0dd57af03734d6450647169d858b3a087f35f41c9e29ad72 WatchSource:0}: Error finding container 5d072a58af72233c0dd57af03734d6450647169d858b3a087f35f41c9e29ad72: Status 404 returned error can't find the container with id 5d072a58af72233c0dd57af03734d6450647169d858b3a087f35f41c9e29ad72
Jul 07 23:43:33.637699 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:33.637682    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 23:43:34.525044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:34.524940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7" event={"ID":"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e","Type":"ContainerStarted","Data":"dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e"}
Jul 07 23:43:34.525044 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:34.525003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7" event={"ID":"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e","Type":"ContainerStarted","Data":"5d072a58af72233c0dd57af03734d6450647169d858b3a087f35f41c9e29ad72"}
Jul 07 23:43:34.525571 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:34.525228    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:34.544498 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:34.544458    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7" podStartSLOduration=2.056831581 podStartE2EDuration="2.544445207s" totalImagesPullingTime="487.613626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:43:34.543045552 +0000 UTC m=+1945.763029642" watchObservedRunningTime="2026-07-07 23:43:34.544445207 +0000 UTC m=+1945.764429296"
Jul 07 23:43:40.536903 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.536873    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:43:40.870830 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.870799    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"]
Jul 07 23:43:40.875685 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.875663    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:40.878857 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.878832    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4bd96c-serving-cert\""
Jul 07 23:43:40.891232 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.891202    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"]
Jul 07 23:43:40.955414 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.955375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0ab703-ef38-440c-8d32-00bb04f6a95a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:40.955600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.955439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dtfn\" (UniqueName: \"kubernetes.io/projected/cf0ab703-ef38-440c-8d32-00bb04f6a95a-kube-api-access-6dtfn\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:40.955600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:40.955515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.057056 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.057021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0ab703-ef38-440c-8d32-00bb04f6a95a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.057290 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.057076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dtfn\" (UniqueName: \"kubernetes.io/projected/cf0ab703-ef38-440c-8d32-00bb04f6a95a-kube-api-access-6dtfn\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.057290 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.057138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.057290 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:43:41.057273    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-serving-cert: secret "maas-api-e2e-inf-b-4bd96c-serving-cert" not found
Jul 07 23:43:41.057474 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:43:41.057331    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls podName:cf0ab703-ef38-440c-8d32-00bb04f6a95a nodeName:}" failed. No retries permitted until 2026-07-07 23:43:41.557315519 +0000 UTC m=+1952.777299590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls") pod "maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k" (UID: "cf0ab703-ef38-440c-8d32-00bb04f6a95a") : secret "maas-api-e2e-inf-b-4bd96c-serving-cert" not found
Jul 07 23:43:41.057723 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.057704    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0ab703-ef38-440c-8d32-00bb04f6a95a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.068502 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.068478    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dtfn\" (UniqueName: \"kubernetes.io/projected/cf0ab703-ef38-440c-8d32-00bb04f6a95a-kube-api-access-6dtfn\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.562220 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.562169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.564702 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.564676    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls\") pod \"maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.786703 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.786670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:41.948638 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:41.948605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"]
Jul 07 23:43:41.950948 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:43:41.950908    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0ab703_ef38_440c_8d32_00bb04f6a95a.slice/crio-0d05c6161022fef7b4322d7ae55533bc88bba55d70541b3b014ccff8197ed4af WatchSource:0}: Error finding container 0d05c6161022fef7b4322d7ae55533bc88bba55d70541b3b014ccff8197ed4af: Status 404 returned error can't find the container with id 0d05c6161022fef7b4322d7ae55533bc88bba55d70541b3b014ccff8197ed4af
Jul 07 23:43:42.585007 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:42.584924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k" event={"ID":"cf0ab703-ef38-440c-8d32-00bb04f6a95a","Type":"ContainerStarted","Data":"16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960"}
Jul 07 23:43:42.585007 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:42.584973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k" event={"ID":"cf0ab703-ef38-440c-8d32-00bb04f6a95a","Type":"ContainerStarted","Data":"0d05c6161022fef7b4322d7ae55533bc88bba55d70541b3b014ccff8197ed4af"}
Jul 07 23:43:42.585405 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:42.585045    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:42.603214 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:42.603170    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k" podStartSLOduration=2.241858234 podStartE2EDuration="2.603153275s" totalImagesPullingTime="361.295041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:43:42.599290662 +0000 UTC m=+1953.819274748" watchObservedRunningTime="2026-07-07 23:43:42.603153275 +0000 UTC m=+1953.823137364"
Jul 07 23:43:48.552311 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:48.552260    2581 patch_prober.go:28] interesting pod/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 23:43:48.552973 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:48.552329    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 23:43:48.596919 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:48.596891    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:43:49.633956 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:49.633924    2581 generic.go:356] "Generic (PLEG): container finished" podID="5c83b61f-62d6-4903-b405-d8c40e976400" containerID="3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3" exitCode=0
Jul 07 23:43:49.634400 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:49.633979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" event={"ID":"5c83b61f-62d6-4903-b405-d8c40e976400","Type":"ContainerDied","Data":"3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3"}
Jul 07 23:43:49.634400 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:49.634374    2581 scope.go:117] "RemoveContainer" containerID="3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3"
Jul 07 23:43:49.635370 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:49.635339    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:43:49.635467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:49.635408    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:43:49.635467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:49.635439    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:43:50.642945 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:50.642903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" event={"ID":"5c83b61f-62d6-4903-b405-d8c40e976400","Type":"ContainerStarted","Data":"85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6"}
Jul 07 23:43:50.888497 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:50.888464    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:50.888671 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:50.888644    2581 patch_prober.go:28] interesting pod/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 07 23:43:50.888716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:50.888698    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 07 23:43:51.888430 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:51.888393    2581 patch_prober.go:28] interesting pod/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 07 23:43:51.888825 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:51.888454    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 07 23:43:52.888218 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:52.888188    2581 patch_prober.go:28] interesting pod/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 07 23:43:52.888432 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:52.888239    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 07 23:43:53.888216 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:53.888165    2581 patch_prober.go:28] interesting pod/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 07 23:43:53.888594 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:53.888233    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 07 23:43:54.892407 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:54.892377    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:54.892807 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:54.892635    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:43:54.893292 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:43:54.893275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:44:50.728118 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.728071    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"]
Jul 07 23:44:50.728741 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.728346    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7" podUID="ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" containerName="maas-api" containerID="cri-o://dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e" gracePeriod=30
Jul 07 23:44:50.988361 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.988301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:44:50.996327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.996302    2581 generic.go:356] "Generic (PLEG): container finished" podID="ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" containerID="dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e" exitCode=0
Jul 07 23:44:50.996456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.996346    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"
Jul 07 23:44:50.996456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.996345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7" event={"ID":"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e","Type":"ContainerDied","Data":"dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e"}
Jul 07 23:44:50.996456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.996419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7" event={"ID":"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e","Type":"ContainerDied","Data":"5d072a58af72233c0dd57af03734d6450647169d858b3a087f35f41c9e29ad72"}
Jul 07 23:44:50.996456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:50.996451    2581 scope.go:117] "RemoveContainer" containerID="dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e"
Jul 07 23:44:51.006644 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.006606    2581 scope.go:117] "RemoveContainer" containerID="dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e"
Jul 07 23:44:51.006936 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:44:51.006912    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e\": container with ID starting with dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e not found: ID does not exist" containerID="dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e"
Jul 07 23:44:51.007041 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.006949    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e"} err="failed to get container status \"dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e\": rpc error: code = NotFound desc = could not find container \"dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e\": container with ID starting with dd770b14a4ddeb123ba008249c77c48960d34432a343214cef1da6904f80430e not found: ID does not exist"
Jul 07 23:44:51.100331 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.100299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls\") pod \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") "
Jul 07 23:44:51.100524 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.100397    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwfnz\" (UniqueName: \"kubernetes.io/projected/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-kube-api-access-wwfnz\") pod \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") "
Jul 07 23:44:51.100524 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.100500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-openshift-service-ca\") pod \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\" (UID: \"ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e\") "
Jul 07 23:44:51.100810 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.100781    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" (UID: "ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:44:51.102416 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.102387    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" (UID: "ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:44:51.102514 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.102437    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-kube-api-access-wwfnz" (OuterVolumeSpecName: "kube-api-access-wwfnz") pod "ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" (UID: "ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e"). InnerVolumeSpecName "kube-api-access-wwfnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:44:51.202086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.202052    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwfnz\" (UniqueName: \"kubernetes.io/projected/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-kube-api-access-wwfnz\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:44:51.202086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.202079    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:44:51.202086 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.202089    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:44:51.319752 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.319726    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"]
Jul 07 23:44:51.325223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.325197    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ddfc0-b8554df87-wggl7"]
Jul 07 23:44:51.503113 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:44:51.503071    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" path="/var/lib/kubelet/pods/ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e/volumes"
Jul 07 23:45:00.138349 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.138282    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"]
Jul 07 23:45:00.138974 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.138953    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" containerName="maas-api"
Jul 07 23:45:00.138974 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.138975    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" containerName="maas-api"
Jul 07 23:45:00.139129 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.139072    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab61c90e-2477-4d6a-a7da-ada9a0b7dd7e" containerName="maas-api"
Jul 07 23:45:00.143483 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.143462    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"]
Jul 07 23:45:00.143617 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.143590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"
Jul 07 23:45:00.146861 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.146840    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"
Jul 07 23:45:00.149895 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.149872    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"]
Jul 07 23:45:00.153920 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.153896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"]
Jul 07 23:45:00.177817 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.177787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7s4m\" (UniqueName: \"kubernetes.io/projected/07e46497-da0b-41ae-986f-ab2823bb24b9-kube-api-access-m7s4m\") pod \"maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4\" (UID: \"07e46497-da0b-41ae-986f-ab2823bb24b9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"
Jul 07 23:45:00.177940 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.177840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbrbb\" (UniqueName: \"kubernetes.io/projected/783206d5-6f50-4a17-b849-a99df5718872-kube-api-access-vbrbb\") pod \"maas-api-key-cleanup-29724465-8n7gr\" (UID: \"783206d5-6f50-4a17-b849-a99df5718872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"
Jul 07 23:45:00.278906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.278880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7s4m\" (UniqueName: \"kubernetes.io/projected/07e46497-da0b-41ae-986f-ab2823bb24b9-kube-api-access-m7s4m\") pod \"maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4\" (UID: \"07e46497-da0b-41ae-986f-ab2823bb24b9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"
Jul 07 23:45:00.279061 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.278914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbrbb\" (UniqueName: \"kubernetes.io/projected/783206d5-6f50-4a17-b849-a99df5718872-kube-api-access-vbrbb\") pod \"maas-api-key-cleanup-29724465-8n7gr\" (UID: \"783206d5-6f50-4a17-b849-a99df5718872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"
Jul 07 23:45:00.287119 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.287074    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbrbb\" (UniqueName: \"kubernetes.io/projected/783206d5-6f50-4a17-b849-a99df5718872-kube-api-access-vbrbb\") pod \"maas-api-key-cleanup-29724465-8n7gr\" (UID: \"783206d5-6f50-4a17-b849-a99df5718872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"
Jul 07 23:45:00.287223 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.287173    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7s4m\" (UniqueName: \"kubernetes.io/projected/07e46497-da0b-41ae-986f-ab2823bb24b9-kube-api-access-m7s4m\") pod \"maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4\" (UID: \"07e46497-da0b-41ae-986f-ab2823bb24b9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"
Jul 07 23:45:00.459005 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.458928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"
Jul 07 23:45:00.468018 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.467997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"
Jul 07 23:45:00.606891 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.606860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"]
Jul 07 23:45:00.608390 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:45:00.608365    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e46497_da0b_41ae_986f_ab2823bb24b9.slice/crio-64c0da6eb08c8e31432877c3478bc8b352c601f66ec916a1ceffa6c4daf25254 WatchSource:0}: Error finding container 64c0da6eb08c8e31432877c3478bc8b352c601f66ec916a1ceffa6c4daf25254: Status 404 returned error can't find the container with id 64c0da6eb08c8e31432877c3478bc8b352c601f66ec916a1ceffa6c4daf25254
Jul 07 23:45:00.633726 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:00.633702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"]
Jul 07 23:45:00.635585 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:45:00.635560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783206d5_6f50_4a17_b849_a99df5718872.slice/crio-5f92e635e448dc4c0f711be5d02805a7010b445bb87d94257361a43358a6c4f7 WatchSource:0}: Error finding container 5f92e635e448dc4c0f711be5d02805a7010b445bb87d94257361a43358a6c4f7: Status 404 returned error can't find the container with id 5f92e635e448dc4c0f711be5d02805a7010b445bb87d94257361a43358a6c4f7
Jul 07 23:45:01.058792 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:01.058763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr" event={"ID":"783206d5-6f50-4a17-b849-a99df5718872","Type":"ContainerStarted","Data":"db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c"}
Jul 07 23:45:01.058940 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:01.058822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr" event={"ID":"783206d5-6f50-4a17-b849-a99df5718872","Type":"ContainerStarted","Data":"5f92e635e448dc4c0f711be5d02805a7010b445bb87d94257361a43358a6c4f7"}
Jul 07 23:45:01.060315 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:01.060292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4" event={"ID":"07e46497-da0b-41ae-986f-ab2823bb24b9","Type":"ContainerStarted","Data":"e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e"}
Jul 07 23:45:01.060406 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:01.060333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4" event={"ID":"07e46497-da0b-41ae-986f-ab2823bb24b9","Type":"ContainerStarted","Data":"64c0da6eb08c8e31432877c3478bc8b352c601f66ec916a1ceffa6c4daf25254"}
Jul 07 23:45:01.073659 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:01.073611    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr" podStartSLOduration=1.073596228 podStartE2EDuration="1.073596228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:45:01.072840992 +0000 UTC m=+2032.292825080" watchObservedRunningTime="2026-07-07 23:45:01.073596228 +0000 UTC m=+2032.293580307"
Jul 07 23:45:01.088016 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:01.087965    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4" podStartSLOduration=1.087948991 podStartE2EDuration="1.087948991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:45:01.087407769 +0000 UTC m=+2032.307391851" watchObservedRunningTime="2026-07-07 23:45:01.087948991 +0000 UTC m=+2032.307933081"
Jul 07 23:45:32.707418 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:32.707332    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"]
Jul 07 23:45:32.708045 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:32.707569    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy" containerID="cri-o://85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6" gracePeriod=30
Jul 07 23:45:33.743135 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:33.743085    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"]
Jul 07 23:45:33.743777 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:33.743731    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k" podUID="cf0ab703-ef38-440c-8d32-00bb04f6a95a" containerName="maas-api" containerID="cri-o://16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960" gracePeriod=30
Jul 07 23:45:33.775034 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:33.775008    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"]
Jul 07 23:45:33.775264 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:33.775242    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4" podUID="07e46497-da0b-41ae-986f-ab2823bb24b9" containerName="cleanup" containerID="cri-o://e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e" gracePeriod=30
Jul 07 23:45:34.002912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.002856    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:45:34.103133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.103088    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0ab703-ef38-440c-8d32-00bb04f6a95a-openshift-service-ca\") pod \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") "
Jul 07 23:45:34.103292 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.103154    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls\") pod \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") "
Jul 07 23:45:34.103292 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.103230    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dtfn\" (UniqueName: \"kubernetes.io/projected/cf0ab703-ef38-440c-8d32-00bb04f6a95a-kube-api-access-6dtfn\") pod \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\" (UID: \"cf0ab703-ef38-440c-8d32-00bb04f6a95a\") "
Jul 07 23:45:34.103515 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.103481    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf0ab703-ef38-440c-8d32-00bb04f6a95a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf0ab703-ef38-440c-8d32-00bb04f6a95a" (UID: "cf0ab703-ef38-440c-8d32-00bb04f6a95a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:45:34.105190 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.105166    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf0ab703-ef38-440c-8d32-00bb04f6a95a" (UID: "cf0ab703-ef38-440c-8d32-00bb04f6a95a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:45:34.105301 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.105202    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf0ab703-ef38-440c-8d32-00bb04f6a95a-kube-api-access-6dtfn" (OuterVolumeSpecName: "kube-api-access-6dtfn") pod "cf0ab703-ef38-440c-8d32-00bb04f6a95a" (UID: "cf0ab703-ef38-440c-8d32-00bb04f6a95a"). InnerVolumeSpecName "kube-api-access-6dtfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:45:34.204439 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.204396    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0ab703-ef38-440c-8d32-00bb04f6a95a-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:34.204439 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.204434    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0ab703-ef38-440c-8d32-00bb04f6a95a-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:34.204439 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.204443    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dtfn\" (UniqueName: \"kubernetes.io/projected/cf0ab703-ef38-440c-8d32-00bb04f6a95a-kube-api-access-6dtfn\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:34.251600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.251562    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf0ab703-ef38-440c-8d32-00bb04f6a95a" containerID="16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960" exitCode=0
Jul 07 23:45:34.251751 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.251609    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"
Jul 07 23:45:34.251751 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.251642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k" event={"ID":"cf0ab703-ef38-440c-8d32-00bb04f6a95a","Type":"ContainerDied","Data":"16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960"}
Jul 07 23:45:34.251751 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.251694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k" event={"ID":"cf0ab703-ef38-440c-8d32-00bb04f6a95a","Type":"ContainerDied","Data":"0d05c6161022fef7b4322d7ae55533bc88bba55d70541b3b014ccff8197ed4af"}
Jul 07 23:45:34.251751 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.251719    2581 scope.go:117] "RemoveContainer" containerID="16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960"
Jul 07 23:45:34.266075 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.266057    2581 scope.go:117] "RemoveContainer" containerID="16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960"
Jul 07 23:45:34.266353 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:45:34.266335    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960\": container with ID starting with 16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960 not found: ID does not exist" containerID="16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960"
Jul 07 23:45:34.266426 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.266361    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960"} err="failed to get container status \"16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960\": rpc error: code = NotFound desc = could not find container \"16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960\": container with ID starting with 16f79322fa91d094df702d83486ead310e8d5e02d66622aa21fd45224ada9960 not found: ID does not exist"
Jul 07 23:45:34.273929 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.273906    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"]
Jul 07 23:45:34.277494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:34.277476    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4bd96c-5f98cff8d6-g2r8k"]
Jul 07 23:45:35.503433 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:35.503396    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf0ab703-ef38-440c-8d32-00bb04f6a95a" path="/var/lib/kubelet/pods/cf0ab703-ef38-440c-8d32-00bb04f6a95a/volumes"
Jul 07 23:45:37.970762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:37.970702    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:45:38.036762 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036728    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-certs\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.036924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c83b61f-62d6-4903-b405-d8c40e976400-istio-podinfo\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.036924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-socket\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.036924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036820    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-envoy\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.036924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c83b61f-62d6-4903-b405-d8c40e976400-istiod-ca-cert\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.036924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-data\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.036924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036884    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-credential-socket\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.036924 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036913    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g7km\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-kube-api-access-4g7km\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.037339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.036937    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-istio-token\") pod \"5c83b61f-62d6-4903-b405-d8c40e976400\" (UID: \"5c83b61f-62d6-4903-b405-d8c40e976400\") "
Jul 07 23:45:38.037339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037028    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:45:38.037339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037159    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:45:38.037339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037252    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c83b61f-62d6-4903-b405-d8c40e976400-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:45:38.037563 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037408    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.037563 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037427    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c83b61f-62d6-4903-b405-d8c40e976400-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.037563 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037442    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.037785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037566    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:45:38.037844 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.037824    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:45:38.039179 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.039152    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c83b61f-62d6-4903-b405-d8c40e976400-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:45:38.039270 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.039192    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:45:38.039270 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.039204    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:45:38.039270 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.039245    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-kube-api-access-4g7km" (OuterVolumeSpecName: "kube-api-access-4g7km") pod "5c83b61f-62d6-4903-b405-d8c40e976400" (UID: "5c83b61f-62d6-4903-b405-d8c40e976400"). InnerVolumeSpecName "kube-api-access-4g7km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:45:38.138505 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.138478    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.138505 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.138502    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g7km\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-kube-api-access-4g7km\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.138655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.138513    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c83b61f-62d6-4903-b405-d8c40e976400-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.138655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.138522    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c83b61f-62d6-4903-b405-d8c40e976400-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.138655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.138530    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.138655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.138538    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c83b61f-62d6-4903-b405-d8c40e976400-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:45:38.278019 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.277939    2581 generic.go:356] "Generic (PLEG): container finished" podID="5c83b61f-62d6-4903-b405-d8c40e976400" containerID="85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6" exitCode=0
Jul 07 23:45:38.278019 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.277996    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"
Jul 07 23:45:38.278356 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.278018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" event={"ID":"5c83b61f-62d6-4903-b405-d8c40e976400","Type":"ContainerDied","Data":"85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6"}
Jul 07 23:45:38.278356 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.278076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm" event={"ID":"5c83b61f-62d6-4903-b405-d8c40e976400","Type":"ContainerDied","Data":"5f6c413692ed1452522fe8c0ff64a2db694c6672e690c816622e837edb7012ed"}
Jul 07 23:45:38.278356 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.278114    2581 scope.go:117] "RemoveContainer" containerID="85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6"
Jul 07 23:45:38.288074 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.288057    2581 scope.go:117] "RemoveContainer" containerID="3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3"
Jul 07 23:45:38.296862 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.296839    2581 scope.go:117] "RemoveContainer" containerID="85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6"
Jul 07 23:45:38.297228 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:45:38.297199    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6\": container with ID starting with 85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6 not found: ID does not exist" containerID="85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6"
Jul 07 23:45:38.297339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.297237    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6"} err="failed to get container status \"85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6\": rpc error: code = NotFound desc = could not find container \"85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6\": container with ID starting with 85e9b2950e150de6f04c26034afb61799f310a2a6424437dfcf6a126d3b0b7c6 not found: ID does not exist"
Jul 07 23:45:38.297339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.297256    2581 scope.go:117] "RemoveContainer" containerID="3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3"
Jul 07 23:45:38.297864 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:45:38.297841    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3\": container with ID starting with 3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3 not found: ID does not exist" containerID="3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3"
Jul 07 23:45:38.297950 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.297870    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3"} err="failed to get container status \"3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3\": rpc error: code = NotFound desc = could not find container \"3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3\": container with ID starting with 3f9e40035efdd2a4917e32f06cf2de6ce41ce6694cb304cde21ad3a0d0c69cc3 not found: ID does not exist"
Jul 07 23:45:38.299971 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.299953    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"]
Jul 07 23:45:38.303593 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:38.303573    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7ddfc0-openshift-default-b69f5c7f7-64dhm"]
Jul 07 23:45:39.503529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:39.503498    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" path="/var/lib/kubelet/pods/5c83b61f-62d6-4903-b405-d8c40e976400/volumes"
Jul 07 23:45:40.486872 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.486841    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"]
Jul 07 23:45:40.487412 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487393    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf0ab703-ef38-440c-8d32-00bb04f6a95a" containerName="maas-api"
Jul 07 23:45:40.487529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487414    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf0ab703-ef38-440c-8d32-00bb04f6a95a" containerName="maas-api"
Jul 07 23:45:40.487529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487428    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy"
Jul 07 23:45:40.487529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487436    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy"
Jul 07 23:45:40.487529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487449    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy"
Jul 07 23:45:40.487529 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487457    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy"
Jul 07 23:45:40.487789 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487593    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy"
Jul 07 23:45:40.487789 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487607    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c83b61f-62d6-4903-b405-d8c40e976400" containerName="istio-proxy"
Jul 07 23:45:40.487789 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.487621    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf0ab703-ef38-440c-8d32-00bb04f6a95a" containerName="maas-api"
Jul 07 23:45:40.492148 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.492130    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.494712 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.494693    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 23:45:40.494712 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.494705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c6a26c-openshift-default-dockercfg-dxmzn\""
Jul 07 23:45:40.503960 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.503929    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"]
Jul 07 23:45:40.560549 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-token\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560549 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p8nx\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-kube-api-access-2p8nx\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560771 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-socket\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560771 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895a8c55-1595-4aa2-9787-a3cf28b09312-istiod-ca-cert\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560771 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-podinfo\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560975 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-credential-socket\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560975 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-certs\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560975 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-data\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.560975 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.560927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-envoy\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662387 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-socket\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662512 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895a8c55-1595-4aa2-9787-a3cf28b09312-istiod-ca-cert\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-podinfo\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-credential-socket\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662585 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-certs\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-data\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-envoy\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-token\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662764 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p8nx\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-kube-api-access-2p8nx\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662972 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662777    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-socket\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.662972 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662943    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-certs\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.663093 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.662977    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-credential-socket\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.663210 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.663187    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895a8c55-1595-4aa2-9787-a3cf28b09312-istiod-ca-cert\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.663299 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.663279    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-data\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.664888 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.664863    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-envoy\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.665046 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.665031    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-podinfo\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.670622 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.670595    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p8nx\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-kube-api-access-2p8nx\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.670970 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.670952    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-token\") pod \"e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") " pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.803240 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.803216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:40.944760 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.944736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"]
Jul 07 23:45:40.946292 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:45:40.946266    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895a8c55_1595_4aa2_9787_a3cf28b09312.slice/crio-fd9cdeb8f391c6a95788814b334e6319dec5b7dc11642f02a886798da42390a6 WatchSource:0}: Error finding container fd9cdeb8f391c6a95788814b334e6319dec5b7dc11642f02a886798da42390a6: Status 404 returned error can't find the container with id fd9cdeb8f391c6a95788814b334e6319dec5b7dc11642f02a886798da42390a6
Jul 07 23:45:40.948358 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.948322    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:45:40.948456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.948385    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:45:40.948456 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:40.948414    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:45:41.299183 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:41.299148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" event={"ID":"895a8c55-1595-4aa2-9787-a3cf28b09312","Type":"ContainerStarted","Data":"68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660"}
Jul 07 23:45:41.299373 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:41.299210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" event={"ID":"895a8c55-1595-4aa2-9787-a3cf28b09312","Type":"ContainerStarted","Data":"fd9cdeb8f391c6a95788814b334e6319dec5b7dc11642f02a886798da42390a6"}
Jul 07 23:45:41.322865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:41.322804    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podStartSLOduration=1.322784805 podStartE2EDuration="1.322784805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:45:41.321235278 +0000 UTC m=+2072.541219373" watchObservedRunningTime="2026-07-07 23:45:41.322784805 +0000 UTC m=+2072.542768895"
Jul 07 23:45:41.803961 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:41.803929    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:42.808634 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:42.808607    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:43.312917 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.312884    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:43.313195 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.313167    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"]
Jul 07 23:45:43.317398 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.317379    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:45:43.317498 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.317459    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.319653 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.319633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c6a26c-serving-cert\""
Jul 07 23:45:43.327216 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.327164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"]
Jul 07 23:45:43.392525 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.392489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.392724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.392535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d247da-245f-407e-b5fc-e8c76f27658a-openshift-service-ca\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.392724 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.392598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg2zx\" (UniqueName: \"kubernetes.io/projected/f6d247da-245f-407e-b5fc-e8c76f27658a-kube-api-access-mg2zx\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.493839 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.493804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.493839 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.493842    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d247da-245f-407e-b5fc-e8c76f27658a-openshift-service-ca\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.494064 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.493881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg2zx\" (UniqueName: \"kubernetes.io/projected/f6d247da-245f-407e-b5fc-e8c76f27658a-kube-api-access-mg2zx\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.494064 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:45:43.493954    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-serving-cert: secret "maas-api-e2e-api-a-c6a26c-serving-cert" not found
Jul 07 23:45:43.494064 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:45:43.494021    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls podName:f6d247da-245f-407e-b5fc-e8c76f27658a nodeName:}" failed. No retries permitted until 2026-07-07 23:45:43.994004684 +0000 UTC m=+2075.213988755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls") pod "maas-api-e2e-api-a-c6a26c-564857688f-6mgxq" (UID: "f6d247da-245f-407e-b5fc-e8c76f27658a") : secret "maas-api-e2e-api-a-c6a26c-serving-cert" not found
Jul 07 23:45:43.494577 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.494554    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d247da-245f-407e-b5fc-e8c76f27658a-openshift-service-ca\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.502636 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.502613    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg2zx\" (UniqueName: \"kubernetes.io/projected/f6d247da-245f-407e-b5fc-e8c76f27658a-kube-api-access-mg2zx\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:43.998569 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:43.998538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:44.000991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:44.000969    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls\") pod \"maas-api-e2e-api-a-c6a26c-564857688f-6mgxq\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:44.231465 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:44.231428    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:44.381937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:44.381912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"]
Jul 07 23:45:44.383879 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:45:44.383844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d247da_245f_407e_b5fc_e8c76f27658a.slice/crio-fd3629c6053f2018a120e471a25e6a95b9cf526fa9f139ea4264babcc9950f85 WatchSource:0}: Error finding container fd3629c6053f2018a120e471a25e6a95b9cf526fa9f139ea4264babcc9950f85: Status 404 returned error can't find the container with id fd3629c6053f2018a120e471a25e6a95b9cf526fa9f139ea4264babcc9950f85
Jul 07 23:45:45.325670 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:45.325632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq" event={"ID":"f6d247da-245f-407e-b5fc-e8c76f27658a","Type":"ContainerStarted","Data":"130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e"}
Jul 07 23:45:45.326149 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:45.325858    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:45.326149 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:45.325909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq" event={"ID":"f6d247da-245f-407e-b5fc-e8c76f27658a","Type":"ContainerStarted","Data":"fd3629c6053f2018a120e471a25e6a95b9cf526fa9f139ea4264babcc9950f85"}
Jul 07 23:45:45.345499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:45.345449    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq" podStartSLOduration=1.912181848 podStartE2EDuration="2.345435982s" totalImagesPullingTime="433.254134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:45:45.342775899 +0000 UTC m=+2076.562760012" watchObservedRunningTime="2026-07-07 23:45:45.345435982 +0000 UTC m=+2076.565420071"
Jul 07 23:45:51.336864 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.336834    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:45:51.379499 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.379465    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"]
Jul 07 23:45:51.384215 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.384190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.387721 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.387699    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0746a7-serving-cert\""
Jul 07 23:45:51.397824 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.397799    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"]
Jul 07 23:45:51.473238 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.473208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.473431 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.473276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnx7\" (UniqueName: \"kubernetes.io/projected/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-kube-api-access-hbnx7\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.473431 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.473390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-openshift-service-ca\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.574591 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.574560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.574766 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.574628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnx7\" (UniqueName: \"kubernetes.io/projected/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-kube-api-access-hbnx7\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.574766 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.574688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-openshift-service-ca\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.574895 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:45:51.574837    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-serving-cert: secret "maas-api-e2e-api-b-0746a7-serving-cert" not found
Jul 07 23:45:51.574952 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:45:51.574918    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls podName:1e6d2f79-2a07-4a2b-a78d-6c1883f11cea nodeName:}" failed. No retries permitted until 2026-07-07 23:45:52.074896526 +0000 UTC m=+2083.294880608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls") pod "maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq" (UID: "1e6d2f79-2a07-4a2b-a78d-6c1883f11cea") : secret "maas-api-e2e-api-b-0746a7-serving-cert" not found
Jul 07 23:45:51.575440 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.575411    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-openshift-service-ca\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:51.583940 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:51.583919    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnx7\" (UniqueName: \"kubernetes.io/projected/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-kube-api-access-hbnx7\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:52.079340 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:52.079305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:52.082054 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:52.082029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls\") pod \"maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:52.298400 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:52.298364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:52.449133 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:52.449092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"]
Jul 07 23:45:52.451602 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:45:52.451575    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6d2f79_2a07_4a2b_a78d_6c1883f11cea.slice/crio-6d5d0b6e51be32943b174a870c271c84b06ee5c37b21180791964a860682bbb9 WatchSource:0}: Error finding container 6d5d0b6e51be32943b174a870c271c84b06ee5c37b21180791964a860682bbb9: Status 404 returned error can't find the container with id 6d5d0b6e51be32943b174a870c271c84b06ee5c37b21180791964a860682bbb9
Jul 07 23:45:53.379017 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:53.378980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq" event={"ID":"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea","Type":"ContainerStarted","Data":"7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8"}
Jul 07 23:45:53.379190 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:53.379033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq" event={"ID":"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea","Type":"ContainerStarted","Data":"6d5d0b6e51be32943b174a870c271c84b06ee5c37b21180791964a860682bbb9"}
Jul 07 23:45:53.379190 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:53.379054    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:45:53.413185 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:53.413134    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq" podStartSLOduration=1.95450341 podStartE2EDuration="2.41311777s" totalImagesPullingTime="458.61436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:45:53.410495437 +0000 UTC m=+2084.630479527" watchObservedRunningTime="2026-07-07 23:45:53.41311777 +0000 UTC m=+2084.633101859"
Jul 07 23:45:59.354313 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:59.354265    2581 patch_prober.go:28] interesting pod/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 23:45:59.354781 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:59.354369    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 23:45:59.390455 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:45:59.390425    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:46:00.011257 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:00.011223    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"]
Jul 07 23:46:00.011452 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:00.011431    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr" podUID="783206d5-6f50-4a17-b849-a99df5718872" containerName="cleanup" containerID="cri-o://db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c" gracePeriod=30
Jul 07 23:46:01.432666 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:01.432634    2581 generic.go:356] "Generic (PLEG): container finished" podID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerID="68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660" exitCode=0
Jul 07 23:46:01.433162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:01.432672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" event={"ID":"895a8c55-1595-4aa2-9787-a3cf28b09312","Type":"ContainerDied","Data":"68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660"}
Jul 07 23:46:01.433162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:01.433067    2581 scope.go:117] "RemoveContainer" containerID="68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660"
Jul 07 23:46:01.434121 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:01.434064    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:01.434185 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:01.434154    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:01.434234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:01.434187    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:02.440582 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:02.440546    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" event={"ID":"895a8c55-1595-4aa2-9787-a3cf28b09312","Type":"ContainerStarted","Data":"c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912"}
Jul 07 23:46:02.803664 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:02.803628    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:46:02.803856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:02.803792    2581 patch_prober.go:28] interesting pod/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 07 23:46:02.803856 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:02.803836    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 07 23:46:03.804181 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:03.804151    2581 patch_prober.go:28] interesting pod/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 07 23:46:03.804496 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:03.804205    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 07 23:46:04.014470 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.014438    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"
Jul 07 23:46:04.111496 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.111464    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7s4m\" (UniqueName: \"kubernetes.io/projected/07e46497-da0b-41ae-986f-ab2823bb24b9-kube-api-access-m7s4m\") pod \"07e46497-da0b-41ae-986f-ab2823bb24b9\" (UID: \"07e46497-da0b-41ae-986f-ab2823bb24b9\") "
Jul 07 23:46:04.113586 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.113559    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e46497-da0b-41ae-986f-ab2823bb24b9-kube-api-access-m7s4m" (OuterVolumeSpecName: "kube-api-access-m7s4m") pod "07e46497-da0b-41ae-986f-ab2823bb24b9" (UID: "07e46497-da0b-41ae-986f-ab2823bb24b9"). InnerVolumeSpecName "kube-api-access-m7s4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:46:04.212403 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.212358    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7s4m\" (UniqueName: \"kubernetes.io/projected/07e46497-da0b-41ae-986f-ab2823bb24b9-kube-api-access-m7s4m\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:04.459436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.459349    2581 generic.go:356] "Generic (PLEG): container finished" podID="07e46497-da0b-41ae-986f-ab2823bb24b9" containerID="e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e" exitCode=137
Jul 07 23:46:04.459436 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.459403    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"
Jul 07 23:46:04.459640 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.459433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4" event={"ID":"07e46497-da0b-41ae-986f-ab2823bb24b9","Type":"ContainerDied","Data":"e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e"}
Jul 07 23:46:04.459640 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.459491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4" event={"ID":"07e46497-da0b-41ae-986f-ab2823bb24b9","Type":"ContainerDied","Data":"64c0da6eb08c8e31432877c3478bc8b352c601f66ec916a1ceffa6c4daf25254"}
Jul 07 23:46:04.459640 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.459514    2581 scope.go:117] "RemoveContainer" containerID="e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e"
Jul 07 23:46:04.469560 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.469541    2581 scope.go:117] "RemoveContainer" containerID="e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e"
Jul 07 23:46:04.469836 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:04.469817    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e\": container with ID starting with e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e not found: ID does not exist" containerID="e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e"
Jul 07 23:46:04.469937 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.469843    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e"} err="failed to get container status \"e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e\": rpc error: code = NotFound desc = could not find container \"e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e\": container with ID starting with e15433956089f97f9a1fa3d45100c778a8f41f1b0072dc3bb949bd41046c3f3e not found: ID does not exist"
Jul 07 23:46:04.481916 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.481893    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"]
Jul 07 23:46:04.489580 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.489558    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4bd96c-29724465-lh8j4"]
Jul 07 23:46:04.746591 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.746478    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"]
Jul 07 23:46:04.747346 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.747032    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq" podUID="f6d247da-245f-407e-b5fc-e8c76f27658a" containerName="maas-api" containerID="cri-o://130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e" gracePeriod=30
Jul 07 23:46:04.804360 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.804329    2581 patch_prober.go:28] interesting pod/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 07 23:46:04.804753 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:04.804385    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 07 23:46:05.061865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.061837    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:46:05.222145 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.222054    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d247da-245f-407e-b5fc-e8c76f27658a-openshift-service-ca\") pod \"f6d247da-245f-407e-b5fc-e8c76f27658a\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") "
Jul 07 23:46:05.222372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.222217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg2zx\" (UniqueName: \"kubernetes.io/projected/f6d247da-245f-407e-b5fc-e8c76f27658a-kube-api-access-mg2zx\") pod \"f6d247da-245f-407e-b5fc-e8c76f27658a\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") "
Jul 07 23:46:05.222372 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.222262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls\") pod \"f6d247da-245f-407e-b5fc-e8c76f27658a\" (UID: \"f6d247da-245f-407e-b5fc-e8c76f27658a\") "
Jul 07 23:46:05.223535 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.223190    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d247da-245f-407e-b5fc-e8c76f27658a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6d247da-245f-407e-b5fc-e8c76f27658a" (UID: "f6d247da-245f-407e-b5fc-e8c76f27658a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:46:05.231121 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.226608    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6d247da-245f-407e-b5fc-e8c76f27658a" (UID: "f6d247da-245f-407e-b5fc-e8c76f27658a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:46:05.234273 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.234235    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d247da-245f-407e-b5fc-e8c76f27658a-kube-api-access-mg2zx" (OuterVolumeSpecName: "kube-api-access-mg2zx") pod "f6d247da-245f-407e-b5fc-e8c76f27658a" (UID: "f6d247da-245f-407e-b5fc-e8c76f27658a"). InnerVolumeSpecName "kube-api-access-mg2zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:46:05.323281 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.323202    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d247da-245f-407e-b5fc-e8c76f27658a-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:05.323281 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.323239    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d247da-245f-407e-b5fc-e8c76f27658a-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:05.323281 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.323254    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg2zx\" (UniqueName: \"kubernetes.io/projected/f6d247da-245f-407e-b5fc-e8c76f27658a-kube-api-access-mg2zx\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:05.467784 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.467746    2581 generic.go:356] "Generic (PLEG): container finished" podID="f6d247da-245f-407e-b5fc-e8c76f27658a" containerID="130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e" exitCode=0
Jul 07 23:46:05.467942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.467798    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"
Jul 07 23:46:05.467942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.467847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq" event={"ID":"f6d247da-245f-407e-b5fc-e8c76f27658a","Type":"ContainerDied","Data":"130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e"}
Jul 07 23:46:05.467942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.467898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq" event={"ID":"f6d247da-245f-407e-b5fc-e8c76f27658a","Type":"ContainerDied","Data":"fd3629c6053f2018a120e471a25e6a95b9cf526fa9f139ea4264babcc9950f85"}
Jul 07 23:46:05.467942 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.467923    2581 scope.go:117] "RemoveContainer" containerID="130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e"
Jul 07 23:46:05.478211 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.478192    2581 scope.go:117] "RemoveContainer" containerID="130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e"
Jul 07 23:46:05.478464 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:05.478446    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e\": container with ID starting with 130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e not found: ID does not exist" containerID="130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e"
Jul 07 23:46:05.478516 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.478473    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e"} err="failed to get container status \"130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e\": rpc error: code = NotFound desc = could not find container \"130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e\": container with ID starting with 130db2c20d890f19cb9fa65887a820ca893d6594eb83140870aca6182d66466e not found: ID does not exist"
Jul 07 23:46:05.490331 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.490303    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"]
Jul 07 23:46:05.492827 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.492807    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6a26c-564857688f-6mgxq"]
Jul 07 23:46:05.503548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.503523    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e46497-da0b-41ae-986f-ab2823bb24b9" path="/var/lib/kubelet/pods/07e46497-da0b-41ae-986f-ab2823bb24b9/volumes"
Jul 07 23:46:05.504012 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.503993    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6d247da-245f-407e-b5fc-e8c76f27658a" path="/var/lib/kubelet/pods/f6d247da-245f-407e-b5fc-e8c76f27658a/volumes"
Jul 07 23:46:05.804462 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.804434    2581 patch_prober.go:28] interesting pod/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 07 23:46:05.804839 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:05.804513    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 07 23:46:06.804633 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:06.804590    2581 patch_prober.go:28] interesting pod/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 07 23:46:06.805023 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:06.804651    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 07 23:46:07.807653 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:07.807624    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:46:07.808038 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:07.807904    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:46:07.808710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:07.808691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:46:10.453690 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:10.453654    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"]
Jul 07 23:46:10.499676 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:10.499643    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy" containerID="cri-o://c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912" gracePeriod=30
Jul 07 23:46:11.508037 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.508000    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"]
Jul 07 23:46:11.508523 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.508253    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq" podUID="1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" containerName="maas-api" containerID="cri-o://7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8" gracePeriod=30
Jul 07 23:46:11.519234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.519213    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:46:11.533539 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.533519    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:46:11.772049 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.771991    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:46:11.889425 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.889392    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls\") pod \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") "
Jul 07 23:46:11.889589 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.889464    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-openshift-service-ca\") pod \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") "
Jul 07 23:46:11.889589 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.889493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbnx7\" (UniqueName: \"kubernetes.io/projected/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-kube-api-access-hbnx7\") pod \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\" (UID: \"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea\") "
Jul 07 23:46:11.889877 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.889848    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" (UID: "1e6d2f79-2a07-4a2b-a78d-6c1883f11cea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:46:11.891647 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.891624    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-kube-api-access-hbnx7" (OuterVolumeSpecName: "kube-api-access-hbnx7") pod "1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" (UID: "1e6d2f79-2a07-4a2b-a78d-6c1883f11cea"). InnerVolumeSpecName "kube-api-access-hbnx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:46:11.891647 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.891631    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" (UID: "1e6d2f79-2a07-4a2b-a78d-6c1883f11cea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:46:11.991128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.991072    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:11.991128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.991129    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:11.991318 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:11.991144    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbnx7\" (UniqueName: \"kubernetes.io/projected/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea-kube-api-access-hbnx7\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:12.516580 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.516547    2581 generic.go:356] "Generic (PLEG): container finished" podID="1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" containerID="7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8" exitCode=0
Jul 07 23:46:12.517018 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.516598    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"
Jul 07 23:46:12.517018 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.516624    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq" event={"ID":"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea","Type":"ContainerDied","Data":"7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8"}
Jul 07 23:46:12.517018 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.516683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq" event={"ID":"1e6d2f79-2a07-4a2b-a78d-6c1883f11cea","Type":"ContainerDied","Data":"6d5d0b6e51be32943b174a870c271c84b06ee5c37b21180791964a860682bbb9"}
Jul 07 23:46:12.517018 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.516706    2581 scope.go:117] "RemoveContainer" containerID="7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8"
Jul 07 23:46:12.527552 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.527534    2581 scope.go:117] "RemoveContainer" containerID="7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8"
Jul 07 23:46:12.527828 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:12.527807    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8\": container with ID starting with 7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8 not found: ID does not exist" containerID="7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8"
Jul 07 23:46:12.527889 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.527836    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8"} err="failed to get container status \"7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8\": rpc error: code = NotFound desc = could not find container \"7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8\": container with ID starting with 7f2097623db325565bba4390c42326a865accf71bd5450f6b7d7b69269a20be8 not found: ID does not exist"
Jul 07 23:46:12.538836 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.538811    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"]
Jul 07 23:46:12.543649 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:12.543631    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0746a7-57c8f469c8-l9swq"]
Jul 07 23:46:13.503032 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:13.503001    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" path="/var/lib/kubelet/pods/1e6d2f79-2a07-4a2b-a78d-6c1883f11cea/volumes"
Jul 07 23:46:15.756160 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.756136    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:46:15.822321 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822290    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-podinfo\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822511 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p8nx\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-kube-api-access-2p8nx\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822511 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-data\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822511 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-credential-socket\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822511 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822427    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895a8c55-1595-4aa2-9787-a3cf28b09312-istiod-ca-cert\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822511 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822468    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-envoy\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822511 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822509    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-socket\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822827 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822583    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-token\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822827 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822639    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-certs\") pod \"895a8c55-1595-4aa2-9787-a3cf28b09312\" (UID: \"895a8c55-1595-4aa2-9787-a3cf28b09312\") "
Jul 07 23:46:15.822827 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822724    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:46:15.822988 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.822946    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:46:15.823076 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.823052    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.823165 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.823073    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.823227 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.823157    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:46:15.823492 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.823465    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895a8c55-1595-4aa2-9787-a3cf28b09312-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:46:15.823607 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.823501    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-data" (OuterVolumeSpecName: "istio-data") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:46:15.825266 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.825243    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:46:15.825422 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.825277    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-kube-api-access-2p8nx" (OuterVolumeSpecName: "kube-api-access-2p8nx") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "kube-api-access-2p8nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:46:15.825422 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.825350    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-token" (OuterVolumeSpecName: "istio-token") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:46:15.825638 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.825621    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "895a8c55-1595-4aa2-9787-a3cf28b09312" (UID: "895a8c55-1595-4aa2-9787-a3cf28b09312"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:46:15.924559 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.924530    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.924559 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.924553    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.924559 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.924564    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p8nx\" (UniqueName: \"kubernetes.io/projected/895a8c55-1595-4aa2-9787-a3cf28b09312-kube-api-access-2p8nx\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.924771 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.924573    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.924771 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.924582    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895a8c55-1595-4aa2-9787-a3cf28b09312-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.924771 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.924590    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:15.924771 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:15.924597    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895a8c55-1595-4aa2-9787-a3cf28b09312-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:16.542878 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.542841    2581 generic.go:356] "Generic (PLEG): container finished" podID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerID="c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912" exitCode=0
Jul 07 23:46:16.543053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.542895    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"
Jul 07 23:46:16.543053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.542934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" event={"ID":"895a8c55-1595-4aa2-9787-a3cf28b09312","Type":"ContainerDied","Data":"c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912"}
Jul 07 23:46:16.543053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.542997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx" event={"ID":"895a8c55-1595-4aa2-9787-a3cf28b09312","Type":"ContainerDied","Data":"fd9cdeb8f391c6a95788814b334e6319dec5b7dc11642f02a886798da42390a6"}
Jul 07 23:46:16.543053 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.543026    2581 scope.go:117] "RemoveContainer" containerID="c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912"
Jul 07 23:46:16.553481 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.553461    2581 scope.go:117] "RemoveContainer" containerID="68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660"
Jul 07 23:46:16.561879 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.561860    2581 scope.go:117] "RemoveContainer" containerID="c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912"
Jul 07 23:46:16.562169 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:16.562144    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912\": container with ID starting with c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912 not found: ID does not exist" containerID="c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912"
Jul 07 23:46:16.562300 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.562179    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912"} err="failed to get container status \"c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912\": rpc error: code = NotFound desc = could not find container \"c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912\": container with ID starting with c14dbf8e9f7ebe596ac65e45f7686a62b7d5315d035444c1232c6bc25f0c2912 not found: ID does not exist"
Jul 07 23:46:16.562300 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.562201    2581 scope.go:117] "RemoveContainer" containerID="68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660"
Jul 07 23:46:16.562451 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:16.562433    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660\": container with ID starting with 68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660 not found: ID does not exist" containerID="68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660"
Jul 07 23:46:16.562487 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.562459    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660"} err="failed to get container status \"68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660\": rpc error: code = NotFound desc = could not find container \"68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660\": container with ID starting with 68b7711af4c521f60b94de0bad338f011bb41a5b78be88fb355940d5cfbda660 not found: ID does not exist"
Jul 07 23:46:16.566896 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.566872    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"]
Jul 07 23:46:16.570611 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:16.570593    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c6a26c-openshift-default-dd8fcb5c-r6jjx"]
Jul 07 23:46:17.503925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:17.503894    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" path="/var/lib/kubelet/pods/895a8c55-1595-4aa2-9787-a3cf28b09312/volumes"
Jul 07 23:46:18.346636 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.346602    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"]
Jul 07 23:46:18.347144 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347124    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" containerName="maas-api"
Jul 07 23:46:18.347144 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347145    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" containerName="maas-api"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347174    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347182    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347201    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d247da-245f-407e-b5fc-e8c76f27658a" containerName="maas-api"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347210    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d247da-245f-407e-b5fc-e8c76f27658a" containerName="maas-api"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347231    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e46497-da0b-41ae-986f-ab2823bb24b9" containerName="cleanup"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347239    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e46497-da0b-41ae-986f-ab2823bb24b9" containerName="cleanup"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347247    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy"
Jul 07 23:46:18.347328 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347254    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy"
Jul 07 23:46:18.347710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347367    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy"
Jul 07 23:46:18.347710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347381    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e46497-da0b-41ae-986f-ab2823bb24b9" containerName="cleanup"
Jul 07 23:46:18.347710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347391    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e6d2f79-2a07-4a2b-a78d-6c1883f11cea" containerName="maas-api"
Jul 07 23:46:18.347710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347400    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d247da-245f-407e-b5fc-e8c76f27658a" containerName="maas-api"
Jul 07 23:46:18.347710 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.347408    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="895a8c55-1595-4aa2-9787-a3cf28b09312" containerName="istio-proxy"
Jul 07 23:46:18.352189 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.352168    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.354713 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.354692    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 23:46:18.354808 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.354697    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b512c6-openshift-default-dockercfg-8dl9h\""
Jul 07 23:46:18.363498 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.363476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"]
Jul 07 23:46:18.448176 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istiod-ca-cert\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448358 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bms4q\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-kube-api-access-bms4q\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448358 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-podinfo\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448358 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-certs\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448358 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-envoy\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-token\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-socket\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-credential-socket\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.448501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.448482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-data\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.549955 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.549927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-envoy\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.549961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-token\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-socket\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-credential-socket\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-data\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istiod-ca-cert\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bms4q\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-kube-api-access-bms4q\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-podinfo\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-certs\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550506    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-data\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550463    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-socket\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.550626 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-credential-socket\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.551136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.550819    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-certs\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.551136 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.551126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istiod-ca-cert\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.552625 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.552600    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-envoy\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.552944 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.552901    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-podinfo\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.557844 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.557822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bms4q\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-kube-api-access-bms4q\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.558256 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.558236    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-token\") pod \"e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") " pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.664212 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.664124    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:18.812938 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.812912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"]
Jul 07 23:46:18.814411 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:46:18.814383    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493f1e3d_e2d5_4bb2_8250_f37c8495ccf9.slice/crio-64e3c17ea944f45abeb9c532aff0d1ef15b7655fe22e8dce4733de3a47ae9d62 WatchSource:0}: Error finding container 64e3c17ea944f45abeb9c532aff0d1ef15b7655fe22e8dce4733de3a47ae9d62: Status 404 returned error can't find the container with id 64e3c17ea944f45abeb9c532aff0d1ef15b7655fe22e8dce4733de3a47ae9d62
Jul 07 23:46:18.816505 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.816474    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:18.816579 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.816537    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:18.816579 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:18.816573    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:19.570967 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:19.570930    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" event={"ID":"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9","Type":"ContainerStarted","Data":"c5bfe2250909410659f501c9024273567de07f7122a73b2d8b754c5470aa514b"}
Jul 07 23:46:19.571423 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:19.571011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" event={"ID":"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9","Type":"ContainerStarted","Data":"64e3c17ea944f45abeb9c532aff0d1ef15b7655fe22e8dce4733de3a47ae9d62"}
Jul 07 23:46:19.592152 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:19.592091    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" podStartSLOduration=1.592077389 podStartE2EDuration="1.592077389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:46:19.589145788 +0000 UTC m=+2110.809129874" watchObservedRunningTime="2026-07-07 23:46:19.592077389 +0000 UTC m=+2110.812061479"
Jul 07 23:46:19.664791 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:19.664763    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:19.669814 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:19.669791    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:20.576696 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:20.576668    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:20.577756 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:20.577736    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:21.696168 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.696133    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"]
Jul 07 23:46:21.699949 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.699922    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.702539 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.702521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b512c6-serving-cert\""
Jul 07 23:46:21.711043 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.710953    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"]
Jul 07 23:46:21.780984 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.780948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f021f5-2d88-4422-8f59-7daaaebf41f5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.781162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.781116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.781162 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.781146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94hs\" (UniqueName: \"kubernetes.io/projected/30f021f5-2d88-4422-8f59-7daaaebf41f5-kube-api-access-s94hs\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.882154 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.882115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f021f5-2d88-4422-8f59-7daaaebf41f5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.882333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.882192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.882333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.882211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s94hs\" (UniqueName: \"kubernetes.io/projected/30f021f5-2d88-4422-8f59-7daaaebf41f5-kube-api-access-s94hs\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.882425 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:21.882335    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-serving-cert: secret "maas-api-e2e-shared-a-b512c6-serving-cert" not found
Jul 07 23:46:21.882425 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:21.882399    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls podName:30f021f5-2d88-4422-8f59-7daaaebf41f5 nodeName:}" failed. No retries permitted until 2026-07-07 23:46:22.382382711 +0000 UTC m=+2113.602366782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls") pod "maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp" (UID: "30f021f5-2d88-4422-8f59-7daaaebf41f5") : secret "maas-api-e2e-shared-a-b512c6-serving-cert" not found
Jul 07 23:46:21.882719 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.882703    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f021f5-2d88-4422-8f59-7daaaebf41f5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:21.894401 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:21.894369    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94hs\" (UniqueName: \"kubernetes.io/projected/30f021f5-2d88-4422-8f59-7daaaebf41f5-kube-api-access-s94hs\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:22.387994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:22.387964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:22.390351 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:22.390324    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls\") pod \"maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:22.613489 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:22.613432    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:22.760679 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:22.760648    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"]
Jul 07 23:46:22.761798 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:46:22.761774    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f021f5_2d88_4422_8f59_7daaaebf41f5.slice/crio-ccf72552c600100b3cc7fb5a2a61e6f987082a66aa1895e113b31de8c20920ee WatchSource:0}: Error finding container ccf72552c600100b3cc7fb5a2a61e6f987082a66aa1895e113b31de8c20920ee: Status 404 returned error can't find the container with id ccf72552c600100b3cc7fb5a2a61e6f987082a66aa1895e113b31de8c20920ee
Jul 07 23:46:23.593906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:23.593875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp" event={"ID":"30f021f5-2d88-4422-8f59-7daaaebf41f5","Type":"ContainerStarted","Data":"cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c"}
Jul 07 23:46:23.594073 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:23.593924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp" event={"ID":"30f021f5-2d88-4422-8f59-7daaaebf41f5","Type":"ContainerStarted","Data":"ccf72552c600100b3cc7fb5a2a61e6f987082a66aa1895e113b31de8c20920ee"}
Jul 07 23:46:23.594073 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:23.594028    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:23.611335 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:23.611291    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp" podStartSLOduration=2.253120066 podStartE2EDuration="2.611274852s" totalImagesPullingTime="358.154786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:46:23.610019557 +0000 UTC m=+2114.830003660" watchObservedRunningTime="2026-07-07 23:46:23.611274852 +0000 UTC m=+2114.831258942"
Jul 07 23:46:29.605069 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.605038    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:46:29.673865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.673833    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"]
Jul 07 23:46:29.678581 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.678559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.688228 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.688202    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-c03c4f-serving-cert\""
Jul 07 23:46:29.700384 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.700359    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"]
Jul 07 23:46:29.756982 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.756950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/398812e4-9954-4dcc-878a-3df0ffb33b6e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.756982 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.756994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8xp\" (UniqueName: \"kubernetes.io/projected/398812e4-9954-4dcc-878a-3df0ffb33b6e-kube-api-access-tx8xp\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.757237 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.757069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/398812e4-9954-4dcc-878a-3df0ffb33b6e-maas-api-tls\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.858345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.858264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/398812e4-9954-4dcc-878a-3df0ffb33b6e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.858345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.858305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8xp\" (UniqueName: \"kubernetes.io/projected/398812e4-9954-4dcc-878a-3df0ffb33b6e-kube-api-access-tx8xp\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.858345 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.858329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/398812e4-9954-4dcc-878a-3df0ffb33b6e-maas-api-tls\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.858912 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.858894    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/398812e4-9954-4dcc-878a-3df0ffb33b6e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.860739 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.860717    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/398812e4-9954-4dcc-878a-3df0ffb33b6e-maas-api-tls\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.876658 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.876632    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8xp\" (UniqueName: \"kubernetes.io/projected/398812e4-9954-4dcc-878a-3df0ffb33b6e-kube-api-access-tx8xp\") pod \"maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:29.989495 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:29.989460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:30.163535 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.163471    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"]
Jul 07 23:46:30.165356 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:46:30.165321    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398812e4_9954_4dcc_878a_3df0ffb33b6e.slice/crio-240c3734822a3ee3a340d64126bdc4e62f925f865242296b79e11b4c55db2db4 WatchSource:0}: Error finding container 240c3734822a3ee3a340d64126bdc4e62f925f865242296b79e11b4c55db2db4: Status 404 returned error can't find the container with id 240c3734822a3ee3a340d64126bdc4e62f925f865242296b79e11b4c55db2db4
Jul 07 23:46:30.214316 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.214292    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"
Jul 07 23:46:30.263151 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.261447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbrbb\" (UniqueName: \"kubernetes.io/projected/783206d5-6f50-4a17-b849-a99df5718872-kube-api-access-vbrbb\") pod \"783206d5-6f50-4a17-b849-a99df5718872\" (UID: \"783206d5-6f50-4a17-b849-a99df5718872\") "
Jul 07 23:46:30.264291 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.264262    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/783206d5-6f50-4a17-b849-a99df5718872-kube-api-access-vbrbb" (OuterVolumeSpecName: "kube-api-access-vbrbb") pod "783206d5-6f50-4a17-b849-a99df5718872" (UID: "783206d5-6f50-4a17-b849-a99df5718872"). InnerVolumeSpecName "kube-api-access-vbrbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:46:30.363009 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.362971    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbrbb\" (UniqueName: \"kubernetes.io/projected/783206d5-6f50-4a17-b849-a99df5718872-kube-api-access-vbrbb\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:46:30.644002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.643959    2581 generic.go:356] "Generic (PLEG): container finished" podID="783206d5-6f50-4a17-b849-a99df5718872" containerID="db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c" exitCode=137
Jul 07 23:46:30.644513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.644111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr" event={"ID":"783206d5-6f50-4a17-b849-a99df5718872","Type":"ContainerDied","Data":"db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c"}
Jul 07 23:46:30.644513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.644168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr" event={"ID":"783206d5-6f50-4a17-b849-a99df5718872","Type":"ContainerDied","Data":"5f92e635e448dc4c0f711be5d02805a7010b445bb87d94257361a43358a6c4f7"}
Jul 07 23:46:30.644513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.644199    2581 scope.go:117] "RemoveContainer" containerID="db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c"
Jul 07 23:46:30.644513 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.644365    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"
Jul 07 23:46:30.656166 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.656124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn" event={"ID":"398812e4-9954-4dcc-878a-3df0ffb33b6e","Type":"ContainerStarted","Data":"be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86"}
Jul 07 23:46:30.656327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.656191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn" event={"ID":"398812e4-9954-4dcc-878a-3df0ffb33b6e","Type":"ContainerStarted","Data":"240c3734822a3ee3a340d64126bdc4e62f925f865242296b79e11b4c55db2db4"}
Jul 07 23:46:30.656327 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.656214    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:30.663888 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.663871    2581 scope.go:117] "RemoveContainer" containerID="db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c"
Jul 07 23:46:30.664145 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:46:30.664127    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c\": container with ID starting with db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c not found: ID does not exist" containerID="db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c"
Jul 07 23:46:30.664193 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.664154    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c"} err="failed to get container status \"db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c\": rpc error: code = NotFound desc = could not find container \"db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c\": container with ID starting with db4fc149df8b406ba8585f3cac69e620e78069d6a37c40f05d4bd83aa7bc4d1c not found: ID does not exist"
Jul 07 23:46:30.678017 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.677963    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn" podStartSLOduration=1.321752346 podStartE2EDuration="1.677944924s" totalImagesPullingTime="356.192578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:46:30.676091482 +0000 UTC m=+2121.896075594" watchObservedRunningTime="2026-07-07 23:46:30.677944924 +0000 UTC m=+2121.897929012"
Jul 07 23:46:30.694920 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.694895    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"]
Jul 07 23:46:30.697429 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:30.697408    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724465-8n7gr"]
Jul 07 23:46:31.503333 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:31.503303    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="783206d5-6f50-4a17-b849-a99df5718872" path="/var/lib/kubelet/pods/783206d5-6f50-4a17-b849-a99df5718872/volumes"
Jul 07 23:46:36.618287 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:36.618244    2581 patch_prober.go:28] interesting pod/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 23:46:36.618708 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:36.618320    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 23:46:36.668716 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:36.668687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:46:37.699447 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:37.699414    2581 generic.go:356] "Generic (PLEG): container finished" podID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerID="c5bfe2250909410659f501c9024273567de07f7122a73b2d8b754c5470aa514b" exitCode=0
Jul 07 23:46:37.699848 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:37.699485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" event={"ID":"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9","Type":"ContainerDied","Data":"c5bfe2250909410659f501c9024273567de07f7122a73b2d8b754c5470aa514b"}
Jul 07 23:46:37.699893 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:37.699867    2581 scope.go:117] "RemoveContainer" containerID="c5bfe2250909410659f501c9024273567de07f7122a73b2d8b754c5470aa514b"
Jul 07 23:46:37.700841 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:37.700807    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:37.700952 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:37.700886    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:37.700952 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:37.700922    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 23:46:38.708267 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:38.708232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" event={"ID":"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9","Type":"ContainerStarted","Data":"cb846101e58a4573b97943e390b9ed384915c1576c3e633e88ab841142c89b2f"}
Jul 07 23:46:39.664998 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:39.664964    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:39.665246 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:39.665223    2581 patch_prober.go:28] interesting pod/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Jul 07 23:46:39.665360 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:39.665291    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Jul 07 23:46:40.665432 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:40.665396    2581 patch_prober.go:28] interesting pod/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Jul 07 23:46:40.665821 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:40.665458    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Jul 07 23:46:41.665076 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:41.665044    2581 patch_prober.go:28] interesting pod/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Jul 07 23:46:41.665318 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:41.665114    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Jul 07 23:46:42.668834 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:42.668806    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:42.669222 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:42.669128    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:46:42.670000 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:46:42.669979    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:49:39.820812 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:39.820777    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"]
Jul 07 23:49:39.821880 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:39.821004    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp" podUID="30f021f5-2d88-4422-8f59-7daaaebf41f5" containerName="maas-api" containerID="cri-o://cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c" gracePeriod=30
Jul 07 23:49:40.082315 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.082258    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:49:40.155587 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.155546    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s94hs\" (UniqueName: \"kubernetes.io/projected/30f021f5-2d88-4422-8f59-7daaaebf41f5-kube-api-access-s94hs\") pod \"30f021f5-2d88-4422-8f59-7daaaebf41f5\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") "
Jul 07 23:49:40.155587 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.155598    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f021f5-2d88-4422-8f59-7daaaebf41f5-openshift-service-ca\") pod \"30f021f5-2d88-4422-8f59-7daaaebf41f5\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") "
Jul 07 23:49:40.155844 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.155684    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls\") pod \"30f021f5-2d88-4422-8f59-7daaaebf41f5\" (UID: \"30f021f5-2d88-4422-8f59-7daaaebf41f5\") "
Jul 07 23:49:40.155966 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.155941    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f021f5-2d88-4422-8f59-7daaaebf41f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "30f021f5-2d88-4422-8f59-7daaaebf41f5" (UID: "30f021f5-2d88-4422-8f59-7daaaebf41f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:49:40.157706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.157682    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "30f021f5-2d88-4422-8f59-7daaaebf41f5" (UID: "30f021f5-2d88-4422-8f59-7daaaebf41f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:49:40.157706 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.157697    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f021f5-2d88-4422-8f59-7daaaebf41f5-kube-api-access-s94hs" (OuterVolumeSpecName: "kube-api-access-s94hs") pod "30f021f5-2d88-4422-8f59-7daaaebf41f5" (UID: "30f021f5-2d88-4422-8f59-7daaaebf41f5"). InnerVolumeSpecName "kube-api-access-s94hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:49:40.257202 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.257172    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s94hs\" (UniqueName: \"kubernetes.io/projected/30f021f5-2d88-4422-8f59-7daaaebf41f5-kube-api-access-s94hs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:40.257202 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.257198    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f021f5-2d88-4422-8f59-7daaaebf41f5-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:40.257370 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.257213    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f021f5-2d88-4422-8f59-7daaaebf41f5-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:40.778285 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.778254    2581 generic.go:356] "Generic (PLEG): container finished" podID="30f021f5-2d88-4422-8f59-7daaaebf41f5" containerID="cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c" exitCode=0
Jul 07 23:49:40.778458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.778298    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"
Jul 07 23:49:40.778458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.778333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp" event={"ID":"30f021f5-2d88-4422-8f59-7daaaebf41f5","Type":"ContainerDied","Data":"cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c"}
Jul 07 23:49:40.778458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.778391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp" event={"ID":"30f021f5-2d88-4422-8f59-7daaaebf41f5","Type":"ContainerDied","Data":"ccf72552c600100b3cc7fb5a2a61e6f987082a66aa1895e113b31de8c20920ee"}
Jul 07 23:49:40.778458 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.778419    2581 scope.go:117] "RemoveContainer" containerID="cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c"
Jul 07 23:49:40.788207 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.788190    2581 scope.go:117] "RemoveContainer" containerID="cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c"
Jul 07 23:49:40.788429 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:49:40.788411    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c\": container with ID starting with cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c not found: ID does not exist" containerID="cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c"
Jul 07 23:49:40.788482 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.788437    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c"} err="failed to get container status \"cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c\": rpc error: code = NotFound desc = could not find container \"cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c\": container with ID starting with cb30b57205fa905bdc01caa74046f5cc3a93169bf126e7d7b91a069411b9570c not found: ID does not exist"
Jul 07 23:49:40.800163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.800141    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"]
Jul 07 23:49:40.803625 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:40.803606    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b512c6-68b4f57fb4-6wtxp"]
Jul 07 23:49:41.503396 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:41.503366    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f021f5-2d88-4422-8f59-7daaaebf41f5" path="/var/lib/kubelet/pods/30f021f5-2d88-4422-8f59-7daaaebf41f5/volumes"
Jul 07 23:49:45.668186 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:45.668149    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"]
Jul 07 23:49:45.668792 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:45.668402    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy" containerID="cri-o://cb846101e58a4573b97943e390b9ed384915c1576c3e633e88ab841142c89b2f" gracePeriod=30
Jul 07 23:49:46.799834 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:46.799799    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"]
Jul 07 23:49:46.800316 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:46.800025    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn" podUID="398812e4-9954-4dcc-878a-3df0ffb33b6e" containerName="maas-api" containerID="cri-o://be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86" gracePeriod=30
Jul 07 23:49:47.066546 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.066525    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:49:47.220572 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.220540    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/398812e4-9954-4dcc-878a-3df0ffb33b6e-openshift-service-ca\") pod \"398812e4-9954-4dcc-878a-3df0ffb33b6e\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") "
Jul 07 23:49:47.220766 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.220611    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx8xp\" (UniqueName: \"kubernetes.io/projected/398812e4-9954-4dcc-878a-3df0ffb33b6e-kube-api-access-tx8xp\") pod \"398812e4-9954-4dcc-878a-3df0ffb33b6e\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") "
Jul 07 23:49:47.220766 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.220655    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/398812e4-9954-4dcc-878a-3df0ffb33b6e-maas-api-tls\") pod \"398812e4-9954-4dcc-878a-3df0ffb33b6e\" (UID: \"398812e4-9954-4dcc-878a-3df0ffb33b6e\") "
Jul 07 23:49:47.221039 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.221012    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398812e4-9954-4dcc-878a-3df0ffb33b6e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "398812e4-9954-4dcc-878a-3df0ffb33b6e" (UID: "398812e4-9954-4dcc-878a-3df0ffb33b6e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:49:47.223161 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.223092    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398812e4-9954-4dcc-878a-3df0ffb33b6e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "398812e4-9954-4dcc-878a-3df0ffb33b6e" (UID: "398812e4-9954-4dcc-878a-3df0ffb33b6e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 23:49:47.223291 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.223166    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398812e4-9954-4dcc-878a-3df0ffb33b6e-kube-api-access-tx8xp" (OuterVolumeSpecName: "kube-api-access-tx8xp") pod "398812e4-9954-4dcc-878a-3df0ffb33b6e" (UID: "398812e4-9954-4dcc-878a-3df0ffb33b6e"). InnerVolumeSpecName "kube-api-access-tx8xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:49:47.322453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.322359    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/398812e4-9954-4dcc-878a-3df0ffb33b6e-maas-api-tls\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:47.322453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.322389    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/398812e4-9954-4dcc-878a-3df0ffb33b6e-openshift-service-ca\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:47.322453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.322402    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx8xp\" (UniqueName: \"kubernetes.io/projected/398812e4-9954-4dcc-878a-3df0ffb33b6e-kube-api-access-tx8xp\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:47.825174 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.825139    2581 generic.go:356] "Generic (PLEG): container finished" podID="398812e4-9954-4dcc-878a-3df0ffb33b6e" containerID="be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86" exitCode=0
Jul 07 23:49:47.825629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.825179    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"
Jul 07 23:49:47.825629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.825202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn" event={"ID":"398812e4-9954-4dcc-878a-3df0ffb33b6e","Type":"ContainerDied","Data":"be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86"}
Jul 07 23:49:47.825629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.825272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn" event={"ID":"398812e4-9954-4dcc-878a-3df0ffb33b6e","Type":"ContainerDied","Data":"240c3734822a3ee3a340d64126bdc4e62f925f865242296b79e11b4c55db2db4"}
Jul 07 23:49:47.825629 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.825311    2581 scope.go:117] "RemoveContainer" containerID="be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86"
Jul 07 23:49:47.834843 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.834828    2581 scope.go:117] "RemoveContainer" containerID="be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86"
Jul 07 23:49:47.835081 ip-10-0-137-221 kubenswrapper[2581]: E0707 23:49:47.835063    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86\": container with ID starting with be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86 not found: ID does not exist" containerID="be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86"
Jul 07 23:49:47.835163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.835092    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86"} err="failed to get container status \"be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86\": rpc error: code = NotFound desc = could not find container \"be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86\": container with ID starting with be35d4befdaf6661d1a360040252ebf17b0d0876d76f8c1601350c96edd92b86 not found: ID does not exist"
Jul 07 23:49:47.842655 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.842635    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"]
Jul 07 23:49:47.847008 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:47.846985    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c03c4f-5c77c788f7-fglnn"]
Jul 07 23:49:49.510776 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:49.510741    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398812e4-9954-4dcc-878a-3df0ffb33b6e" path="/var/lib/kubelet/pods/398812e4-9954-4dcc-878a-3df0ffb33b6e/volumes"
Jul 07 23:49:50.847601 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:50.847571    2581 generic.go:356] "Generic (PLEG): container finished" podID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerID="cb846101e58a4573b97943e390b9ed384915c1576c3e633e88ab841142c89b2f" exitCode=0
Jul 07 23:49:50.847948 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:50.847640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" event={"ID":"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9","Type":"ContainerDied","Data":"cb846101e58a4573b97943e390b9ed384915c1576c3e633e88ab841142c89b2f"}
Jul 07 23:49:50.847948 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:50.847699    2581 scope.go:117] "RemoveContainer" containerID="c5bfe2250909410659f501c9024273567de07f7122a73b2d8b754c5470aa514b"
Jul 07 23:49:50.934600 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:50.934546    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:49:51.058656 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058629    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-token\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.058835 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058699    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bms4q\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-kube-api-access-bms4q\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.058835 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058725    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-data\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.058835 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058743    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istiod-ca-cert\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.058835 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058795    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-socket\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.058835 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058821    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-credential-socket\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.059085 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058851    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-certs\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.059085 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058884    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-envoy\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.059085 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.058927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-podinfo\") pod \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\" (UID: \"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9\") "
Jul 07 23:49:51.059295 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.059260    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:49:51.059369 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.059277    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:49:51.059369 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.059315    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 23:49:51.059590 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.059563    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:49:51.059725 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.059675    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-data" (OuterVolumeSpecName: "istio-data") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:49:51.061001 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.060974    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-token" (OuterVolumeSpecName: "istio-token") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:49:51.061128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.061011    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-kube-api-access-bms4q" (OuterVolumeSpecName: "kube-api-access-bms4q") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "kube-api-access-bms4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 23:49:51.061128 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.061049    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 23:49:51.061367 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.061349    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" (UID: "493f1e3d-e2d5-4bb2-8250-f37c8495ccf9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 23:49:51.159787 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159758    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-envoy\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159787 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159783    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-podinfo\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159787 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159792    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-token\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159800    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bms4q\" (UniqueName: \"kubernetes.io/projected/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-kube-api-access-bms4q\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159810    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istio-data\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159817    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-istiod-ca-cert\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159826    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159834    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-credential-socket\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.159991 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.159842    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9-workload-certs\") on node \"ip-10-0-137-221.ec2.internal\" DevicePath \"\""
Jul 07 23:49:51.854608 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.854581    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"
Jul 07 23:49:51.854608 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.854590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk" event={"ID":"493f1e3d-e2d5-4bb2-8250-f37c8495ccf9","Type":"ContainerDied","Data":"64e3c17ea944f45abeb9c532aff0d1ef15b7655fe22e8dce4733de3a47ae9d62"}
Jul 07 23:49:51.855154 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.854641    2581 scope.go:117] "RemoveContainer" containerID="cb846101e58a4573b97943e390b9ed384915c1576c3e633e88ab841142c89b2f"
Jul 07 23:49:51.872292 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.872267    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"]
Jul 07 23:49:51.876840 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:51.876813    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b512c6-openshift-default-b4669fd79-wvckk"]
Jul 07 23:49:53.502939 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:53.502909    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" path="/var/lib/kubelet/pods/493f1e3d-e2d5-4bb2-8250-f37c8495ccf9/volumes"
Jul 07 23:49:57.881583 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:57.881550    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g9nfc_386c9243-11c7-4f03-b19d-2acda4db5784/manager/0.log"
Jul 07 23:49:58.001525 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:58.001488    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6rdz2_2720e0d2-299b-4688-8e53-7742c860d5af/manager/0.log"
Jul 07 23:49:58.125609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:58.125578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54d6fc6777-rl2xf_202107b5-93d0-4ff9-a32d-ab020ff10b61/manager/0.log"
Jul 07 23:49:58.240630 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:58.240554    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jjbh7_a984dd74-baef-4991-94c0-d2da18c61fff/server/0.log"
Jul 07 23:49:58.595925 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:58.595902    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-tz6t7_79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1/copy-manifests/0.log"
Jul 07 23:49:58.608308 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:58.608282    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-tz6t7_79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1/manager/0.log"
Jul 07 23:49:59.528651 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.528609    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg_76a17912-0203-432c-ba5e-fbc7e08f54e7/util/0.log"
Jul 07 23:49:59.534611 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.534593    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg_76a17912-0203-432c-ba5e-fbc7e08f54e7/pull/0.log"
Jul 07 23:49:59.540234 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.540209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg_76a17912-0203-432c-ba5e-fbc7e08f54e7/extract/0.log"
Jul 07 23:49:59.653621 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.653593    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq_d75dc54e-4c86-4c1b-ab46-7f805de3706c/util/0.log"
Jul 07 23:49:59.659419 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.659393    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq_d75dc54e-4c86-4c1b-ab46-7f805de3706c/pull/0.log"
Jul 07 23:49:59.665179 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.665161    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq_d75dc54e-4c86-4c1b-ab46-7f805de3706c/extract/0.log"
Jul 07 23:49:59.785207 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.785135    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r_063d391d-607d-44a4-a558-b4403c5260e0/util/0.log"
Jul 07 23:49:59.791199 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.791181    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r_063d391d-607d-44a4-a558-b4403c5260e0/pull/0.log"
Jul 07 23:49:59.797041 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.797022    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r_063d391d-607d-44a4-a558-b4403c5260e0/extract/0.log"
Jul 07 23:49:59.907865 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.907841    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb_10a78d13-ae61-48dc-aff0-8fe2c79b2807/util/0.log"
Jul 07 23:49:59.913681 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.913665    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb_10a78d13-ae61-48dc-aff0-8fe2c79b2807/pull/0.log"
Jul 07 23:49:59.919039 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:49:59.919019    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb_10a78d13-ae61-48dc-aff0-8fe2c79b2807/extract/0.log"
Jul 07 23:50:00.152631 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:00.152599    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6vfnv_ccbd60be-5bf2-49ee-8336-54505da3e15c/manager/0.log"
Jul 07 23:50:00.258154 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:00.258095    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rt4w7_563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9/manager/0.log"
Jul 07 23:50:00.375869 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:00.375841    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nsw2s_58ca10a0-ba6f-493b-b718-a928190b6084/kuadrant-console-plugin/0.log"
Jul 07 23:50:00.500545 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:00.500471    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6qzj7_cd1ad209-a90e-4456-a02c-ef3531a1ce7b/registry-server/0.log"
Jul 07 23:50:00.624553 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:00.624524    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9csbb_322da3bf-6b5c-441c-a6aa-d56ced04f950/manager/0.log"
Jul 07 23:50:00.871533 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:00.871452    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8jd24_553d7e56-df5b-43e3-b11c-06f12cec0f9a/manager/0.log"
Jul 07 23:50:01.581013 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:01.580986    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-s8h6n_6eff03bd-cd00-4df7-a921-8924a31dfbc7/kube-auth-proxy/0.log"
Jul 07 23:50:01.945943 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:01.945863    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5g6fh_8462f7e6-27b5-4ee3-98c0-7af03a8109b3/payload-processing/0.log"
Jul 07 23:50:02.067922 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:02.067886    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d8c8946bf-skgkk_7fe35cca-ab40-4105-ad17-eff2a9ecef1c/router/0.log"
Jul 07 23:50:02.653649 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:02.653612    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-xf8pc_c30781cf-fbd0-42d1-8b9b-61c6a81e660e/main/0.log"
Jul 07 23:50:06.900036 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.899999    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6rh9f/must-gather-q4mmq"]
Jul 07 23:50:06.900441 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900427    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="783206d5-6f50-4a17-b849-a99df5718872" containerName="cleanup"
Jul 07 23:50:06.900441 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900441    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="783206d5-6f50-4a17-b849-a99df5718872" containerName="cleanup"
Jul 07 23:50:06.900517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900452    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy"
Jul 07 23:50:06.900517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900459    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy"
Jul 07 23:50:06.900517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900471    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398812e4-9954-4dcc-878a-3df0ffb33b6e" containerName="maas-api"
Jul 07 23:50:06.900517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900476    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="398812e4-9954-4dcc-878a-3df0ffb33b6e" containerName="maas-api"
Jul 07 23:50:06.900517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900495    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f021f5-2d88-4422-8f59-7daaaebf41f5" containerName="maas-api"
Jul 07 23:50:06.900517 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900502    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f021f5-2d88-4422-8f59-7daaaebf41f5" containerName="maas-api"
Jul 07 23:50:06.900701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900558    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f021f5-2d88-4422-8f59-7daaaebf41f5" containerName="maas-api"
Jul 07 23:50:06.900701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900567    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="398812e4-9954-4dcc-878a-3df0ffb33b6e" containerName="maas-api"
Jul 07 23:50:06.900701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900573    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy"
Jul 07 23:50:06.900701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900579    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="783206d5-6f50-4a17-b849-a99df5718872" containerName="cleanup"
Jul 07 23:50:06.900701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900584    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy"
Jul 07 23:50:06.900701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900659    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy"
Jul 07 23:50:06.900701 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.900665    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="493f1e3d-e2d5-4bb2-8250-f37c8495ccf9" containerName="istio-proxy"
Jul 07 23:50:06.905806 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.905784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:06.908933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.908914    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6rh9f\"/\"kube-root-ca.crt\""
Jul 07 23:50:06.909274 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.909259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6rh9f\"/\"openshift-service-ca.crt\""
Jul 07 23:50:06.909339 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.909262    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6rh9f\"/\"default-dockercfg-kv9vp\""
Jul 07 23:50:06.927906 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.927881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rh9f/must-gather-q4mmq"]
Jul 07 23:50:06.985294 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.985254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/575925a7-01b7-4a00-b5cd-d3a4279ec0f2-must-gather-output\") pod \"must-gather-q4mmq\" (UID: \"575925a7-01b7-4a00-b5cd-d3a4279ec0f2\") " pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:06.985474 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:06.985370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4hsv\" (UniqueName: \"kubernetes.io/projected/575925a7-01b7-4a00-b5cd-d3a4279ec0f2-kube-api-access-d4hsv\") pod \"must-gather-q4mmq\" (UID: \"575925a7-01b7-4a00-b5cd-d3a4279ec0f2\") " pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:07.085969 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.085934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4hsv\" (UniqueName: \"kubernetes.io/projected/575925a7-01b7-4a00-b5cd-d3a4279ec0f2-kube-api-access-d4hsv\") pod \"must-gather-q4mmq\" (UID: \"575925a7-01b7-4a00-b5cd-d3a4279ec0f2\") " pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:07.086166 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.085991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/575925a7-01b7-4a00-b5cd-d3a4279ec0f2-must-gather-output\") pod \"must-gather-q4mmq\" (UID: \"575925a7-01b7-4a00-b5cd-d3a4279ec0f2\") " pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:07.086308 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.086293    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/575925a7-01b7-4a00-b5cd-d3a4279ec0f2-must-gather-output\") pod \"must-gather-q4mmq\" (UID: \"575925a7-01b7-4a00-b5cd-d3a4279ec0f2\") " pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:07.100542 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.100516    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4hsv\" (UniqueName: \"kubernetes.io/projected/575925a7-01b7-4a00-b5cd-d3a4279ec0f2-kube-api-access-d4hsv\") pod \"must-gather-q4mmq\" (UID: \"575925a7-01b7-4a00-b5cd-d3a4279ec0f2\") " pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:07.215841 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.215753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rh9f/must-gather-q4mmq"
Jul 07 23:50:07.350467 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.350445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rh9f/must-gather-q4mmq"]
Jul 07 23:50:07.352396 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:50:07.352364    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod575925a7_01b7_4a00_b5cd_d3a4279ec0f2.slice/crio-1b3623d19ddca6b6e17910e8c686848bebc6cdb775c43b100f73f21f4dfa62ba WatchSource:0}: Error finding container 1b3623d19ddca6b6e17910e8c686848bebc6cdb775c43b100f73f21f4dfa62ba: Status 404 returned error can't find the container with id 1b3623d19ddca6b6e17910e8c686848bebc6cdb775c43b100f73f21f4dfa62ba
Jul 07 23:50:07.354303 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.354286    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 23:50:07.962151 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:07.962087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rh9f/must-gather-q4mmq" event={"ID":"575925a7-01b7-4a00-b5cd-d3a4279ec0f2","Type":"ContainerStarted","Data":"1b3623d19ddca6b6e17910e8c686848bebc6cdb775c43b100f73f21f4dfa62ba"}
Jul 07 23:50:08.973682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:08.973641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rh9f/must-gather-q4mmq" event={"ID":"575925a7-01b7-4a00-b5cd-d3a4279ec0f2","Type":"ContainerStarted","Data":"d3856e96380f7ef031d9db7e3850bab1e1a44a750f1e060c6b9d4326585fd4eb"}
Jul 07 23:50:08.973682 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:08.973689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rh9f/must-gather-q4mmq" event={"ID":"575925a7-01b7-4a00-b5cd-d3a4279ec0f2","Type":"ContainerStarted","Data":"aea9f18995f76c174eee8ee0fc49e7baeffd08c145c954262ca331f190962b68"}
Jul 07 23:50:08.990990 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:08.990931    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6rh9f/must-gather-q4mmq" podStartSLOduration=2.05113094 podStartE2EDuration="2.990912049s" totalImagesPullingTime="939.781109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:50:08.989354112 +0000 UTC m=+2340.209338202" watchObservedRunningTime="2026-07-07 23:50:08.990912049 +0000 UTC m=+2340.210896141"
Jul 07 23:50:09.790781 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:09.790755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-frvk2_dd7ffe5a-2577-4511-99d8-79de623c8a52/global-pull-secret-syncer/0.log"
Jul 07 23:50:09.897798 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:09.897772    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q87nj_1fd79631-0b39-4e10-a8d3-2bcba019f02f/konnectivity-agent/0.log"
Jul 07 23:50:09.960163 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:09.960136    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-221.ec2.internal_7bbdb5085a3e8dfea100c8d181fc213b/haproxy/0.log"
Jul 07 23:50:14.235326 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.235246    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg_76a17912-0203-432c-ba5e-fbc7e08f54e7/extract/0.log"
Jul 07 23:50:14.260589 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.260557    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg_76a17912-0203-432c-ba5e-fbc7e08f54e7/util/0.log"
Jul 07 23:50:14.280074 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.280042    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ff9wg_76a17912-0203-432c-ba5e-fbc7e08f54e7/pull/0.log"
Jul 07 23:50:14.305011 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.304960    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq_d75dc54e-4c86-4c1b-ab46-7f805de3706c/extract/0.log"
Jul 07 23:50:14.322374 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.322350    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq_d75dc54e-4c86-4c1b-ab46-7f805de3706c/util/0.log"
Jul 07 23:50:14.340712 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.340657    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqkxq_d75dc54e-4c86-4c1b-ab46-7f805de3706c/pull/0.log"
Jul 07 23:50:14.374002 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.373958    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r_063d391d-607d-44a4-a558-b4403c5260e0/extract/0.log"
Jul 07 23:50:14.391785 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.391699    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r_063d391d-607d-44a4-a558-b4403c5260e0/util/0.log"
Jul 07 23:50:14.422653 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.422618    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hn87r_063d391d-607d-44a4-a558-b4403c5260e0/pull/0.log"
Jul 07 23:50:14.444402 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.444370    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb_10a78d13-ae61-48dc-aff0-8fe2c79b2807/extract/0.log"
Jul 07 23:50:14.462087 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.462059    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb_10a78d13-ae61-48dc-aff0-8fe2c79b2807/util/0.log"
Jul 07 23:50:14.487023 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.486977    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rl2vb_10a78d13-ae61-48dc-aff0-8fe2c79b2807/pull/0.log"
Jul 07 23:50:14.747746 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.747661    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6vfnv_ccbd60be-5bf2-49ee-8336-54505da3e15c/manager/0.log"
Jul 07 23:50:14.780622 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.780539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rt4w7_563b4ac5-2eb2-4f7b-8c67-dac6c042e1a9/manager/0.log"
Jul 07 23:50:14.807864 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.807815    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nsw2s_58ca10a0-ba6f-493b-b718-a928190b6084/kuadrant-console-plugin/0.log"
Jul 07 23:50:14.845232 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.845200    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6qzj7_cd1ad209-a90e-4456-a02c-ef3531a1ce7b/registry-server/0.log"
Jul 07 23:50:14.940420 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:14.940392    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9csbb_322da3bf-6b5c-441c-a6aa-d56ced04f950/manager/0.log"
Jul 07 23:50:15.030501 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:15.030348    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8jd24_553d7e56-df5b-43e3-b11c-06f12cec0f9a/manager/0.log"
Jul 07 23:50:16.772931 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:16.772902    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-69h7v_f7c21abc-e29d-4ea8-a144-33e1a71ce69a/cluster-monitoring-operator/0.log"
Jul 07 23:50:16.912129 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:16.912082    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-spt22_2d77f865-d067-44c5-91aa-5c58e6e2aaef/monitoring-plugin/0.log"
Jul 07 23:50:17.091160 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.091123    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-svjvw_73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a/node-exporter/0.log"
Jul 07 23:50:17.108715 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.108671    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-svjvw_73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a/kube-rbac-proxy/0.log"
Jul 07 23:50:17.129166 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.129142    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-svjvw_73dbfc24-13c5-4b99-b5dc-a00d2ab7fb7a/init-textfile/0.log"
Jul 07 23:50:17.377609 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.377530    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-b9dtl_b34cffc4-0aee-41a6-8592-6743a8869d8c/prometheus-operator/0.log"
Jul 07 23:50:17.392933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.392907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-b9dtl_b34cffc4-0aee-41a6-8592-6743a8869d8c/kube-rbac-proxy/0.log"
Jul 07 23:50:17.447119 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.447079    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cbc45fbb9-njtz4_ba5b8869-74a8-4086-b0c3-637e9526f83b/telemeter-client/0.log"
Jul 07 23:50:17.466933 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.466904    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cbc45fbb9-njtz4_ba5b8869-74a8-4086-b0c3-637e9526f83b/reload/0.log"
Jul 07 23:50:17.490242 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.490215    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cbc45fbb9-njtz4_ba5b8869-74a8-4086-b0c3-637e9526f83b/kube-rbac-proxy/0.log"
Jul 07 23:50:17.524694 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.524657    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85747cbbb8-2hm8h_e6ab011a-d6fc-40bf-b825-beb963924b12/thanos-query/0.log"
Jul 07 23:50:17.547630 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.547602    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85747cbbb8-2hm8h_e6ab011a-d6fc-40bf-b825-beb963924b12/kube-rbac-proxy-web/0.log"
Jul 07 23:50:17.564668 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.564638    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85747cbbb8-2hm8h_e6ab011a-d6fc-40bf-b825-beb963924b12/kube-rbac-proxy/0.log"
Jul 07 23:50:17.584673 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.584649    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85747cbbb8-2hm8h_e6ab011a-d6fc-40bf-b825-beb963924b12/prom-label-proxy/0.log"
Jul 07 23:50:17.603453 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.603427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85747cbbb8-2hm8h_e6ab011a-d6fc-40bf-b825-beb963924b12/kube-rbac-proxy-rules/0.log"
Jul 07 23:50:17.621831 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:17.621806    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85747cbbb8-2hm8h_e6ab011a-d6fc-40bf-b825-beb963924b12/kube-rbac-proxy-metrics/0.log"
Jul 07 23:50:18.907216 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:18.907170    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-sksvb_5ea09130-18f6-4f42-9224-35f915cd3db5/networking-console-plugin/0.log"
Jul 07 23:50:19.502905 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:19.502876    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/1.log"
Jul 07 23:50:19.509170 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:19.509141    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-57gv8_b19a2694-8829-4e1a-b95b-d84c78c40fd4/console-operator/2.log"
Jul 07 23:50:20.063642 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.063607    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"]
Jul 07 23:50:20.073150 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.072408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.076956 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.076903    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67d8d5d97d-k8z65_c779ccbc-1132-4076-83d3-fdbaa6b0d8ed/console/0.log"
Jul 07 23:50:20.079209 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.077878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"]
Jul 07 23:50:20.120618 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.120583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-lib-modules\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.120813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.120637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dgt\" (UniqueName: \"kubernetes.io/projected/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-kube-api-access-v5dgt\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.120813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.120745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-sys\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.120813 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.120804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-proc\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.121006 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.120942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-podres\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.221994 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.221952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-sys\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.222190 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-proc\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.222190 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-podres\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.222190 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-lib-modules\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.222366 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dgt\" (UniqueName: \"kubernetes.io/projected/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-kube-api-access-v5dgt\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.222684 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222644    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-sys\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.222802 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222732    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-proc\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.222868 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222835    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-podres\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.223478 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.222921    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-lib-modules\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.231157 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.231136    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dgt\" (UniqueName: \"kubernetes.io/projected/ed2e71e0-56e1-46aa-b465-df019f4b2bb4-kube-api-access-v5dgt\") pod \"perf-node-gather-daemonset-rm94p\" (UID: \"ed2e71e0-56e1-46aa-b465-df019f4b2bb4\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.390546 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.390451    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:20.578124 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.576379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"]
Jul 07 23:50:20.580787 ip-10-0-137-221 kubenswrapper[2581]: W0707 23:50:20.580740    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poded2e71e0_56e1_46aa_b465_df019f4b2bb4.slice/crio-3d61badd6b695d761d03e4662426a63ad95136ca71fd9aa17e0056943529edfd WatchSource:0}: Error finding container 3d61badd6b695d761d03e4662426a63ad95136ca71fd9aa17e0056943529edfd: Status 404 returned error can't find the container with id 3d61badd6b695d761d03e4662426a63ad95136ca71fd9aa17e0056943529edfd
Jul 07 23:50:20.820142 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:20.820109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-szn8n_6c034d2e-03e0-4194-af72-a546a657b0ed/volume-data-source-validator/0.log"
Jul 07 23:50:21.081210 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:21.081172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p" event={"ID":"ed2e71e0-56e1-46aa-b465-df019f4b2bb4","Type":"ContainerStarted","Data":"a736b46186cc7bad3faef5ad161a5c4c3089a025c49a8e9bc90a5a6e966e2bed"}
Jul 07 23:50:21.081604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:21.081234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p" event={"ID":"ed2e71e0-56e1-46aa-b465-df019f4b2bb4","Type":"ContainerStarted","Data":"3d61badd6b695d761d03e4662426a63ad95136ca71fd9aa17e0056943529edfd"}
Jul 07 23:50:21.081604 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:21.081394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:21.097055 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:21.097005    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p" podStartSLOduration=1.09698943 podStartE2EDuration="1.09698943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:50:21.095644631 +0000 UTC m=+2352.315628720" watchObservedRunningTime="2026-07-07 23:50:21.09698943 +0000 UTC m=+2352.316973518"
Jul 07 23:50:21.869439 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:21.869409    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vn985_849cba2a-0dd1-4b10-b415-f3b69b206ff2/dns/0.log"
Jul 07 23:50:21.886297 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:21.886272    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vn985_849cba2a-0dd1-4b10-b415-f3b69b206ff2/kube-rbac-proxy/0.log"
Jul 07 23:50:21.952270 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:21.952226    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7j978_0fd94d7c-e1ae-4155-bd6d-60504cf4c0ac/dns-node-resolver/0.log"
Jul 07 23:50:22.503489 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:22.503463    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gpv7s_5cd5bfae-3ca7-42df-8dcf-0c8a409818ed/node-ca/0.log"
Jul 07 23:50:23.556325 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:23.556292    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-s8h6n_6eff03bd-cd00-4df7-a921-8924a31dfbc7/kube-auth-proxy/0.log"
Jul 07 23:50:23.701666 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:23.701636    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5g6fh_8462f7e6-27b5-4ee3-98c0-7af03a8109b3/payload-processing/0.log"
Jul 07 23:50:23.722127 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:23.722087    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d8c8946bf-skgkk_7fe35cca-ab40-4105-ad17-eff2a9ecef1c/router/0.log"
Jul 07 23:50:24.415282 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:24.415251    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgnw5_9a5affdc-9b21-48a5-b731-1092e540e3f4/serve-healthcheck-canary/0.log"
Jul 07 23:50:24.898019 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:24.897978    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-ltgrj_901604ec-d101-44ac-a0b8-ef3230d3c972/insights-operator/0.log"
Jul 07 23:50:24.898504 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:24.898179    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-ltgrj_901604ec-d101-44ac-a0b8-ef3230d3c972/insights-operator/1.log"
Jul 07 23:50:25.062889 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:25.062862    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jl6ms_04bad7be-83bb-4424-a30f-49d8f99e1110/kube-rbac-proxy/0.log"
Jul 07 23:50:25.080152 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:25.080124    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jl6ms_04bad7be-83bb-4424-a30f-49d8f99e1110/exporter/0.log"
Jul 07 23:50:25.097801 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:25.097772    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jl6ms_04bad7be-83bb-4424-a30f-49d8f99e1110/extractor/0.log"
Jul 07 23:50:27.101138 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:27.101092    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-rm94p"
Jul 07 23:50:27.233767 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:27.233740    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g9nfc_386c9243-11c7-4f03-b19d-2acda4db5784/manager/0.log"
Jul 07 23:50:27.359660 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:27.359575    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6rdz2_2720e0d2-299b-4688-8e53-7742c860d5af/manager/0.log"
Jul 07 23:50:27.467216 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:27.467172    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54d6fc6777-rl2xf_202107b5-93d0-4ff9-a32d-ab020ff10b61/manager/0.log"
Jul 07 23:50:27.483583 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:27.483560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jjbh7_a984dd74-baef-4991-94c0-d2da18c61fff/server/0.log"
Jul 07 23:50:27.659132 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:27.659031    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-tz6t7_79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1/manager/0.log"
Jul 07 23:50:27.674301 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:27.674278    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-tz6t7_79aaa017-28c4-4eb1-b40d-ccb8bc1cc6d1/copy-manifests/0.log"
Jul 07 23:50:30.372271 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:30.372241    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-s8h6n_6eff03bd-cd00-4df7-a921-8924a31dfbc7/kube-auth-proxy/0.log"
Jul 07 23:50:30.486418 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:30.486334    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5g6fh_8462f7e6-27b5-4ee3-98c0-7af03a8109b3/payload-processing/0.log"
Jul 07 23:50:30.497885 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:30.497855    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d8c8946bf-skgkk_7fe35cca-ab40-4105-ad17-eff2a9ecef1c/router/0.log"
Jul 07 23:50:31.837176 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:31.837130    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-s8h6n_6eff03bd-cd00-4df7-a921-8924a31dfbc7/kube-auth-proxy/0.log"
Jul 07 23:50:31.967494 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:31.967411    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5g6fh_8462f7e6-27b5-4ee3-98c0-7af03a8109b3/payload-processing/0.log"
Jul 07 23:50:31.984176 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:31.984150    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d8c8946bf-skgkk_7fe35cca-ab40-4105-ad17-eff2a9ecef1c/router/0.log"
Jul 07 23:50:34.377356 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:34.377319    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-p9shz_973dd265-f78a-47c5-a6fb-ea9ba76e8124/kube-storage-version-migrator-operator/1.log"
Jul 07 23:50:34.378428 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:34.378402    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-p9shz_973dd265-f78a-47c5-a6fb-ea9ba76e8124/kube-storage-version-migrator-operator/0.log"
Jul 07 23:50:35.293835 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.293801    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4sdmq_c44516f3-0926-446d-a0fd-de3c3e71e567/kube-multus/0.log"
Jul 07 23:50:35.313548 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.313528    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjztw_bd5bf802-afe5-4a9e-88ac-764613fdd218/kube-multus-additional-cni-plugins/0.log"
Jul 07 23:50:35.330861 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.330835    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjztw_bd5bf802-afe5-4a9e-88ac-764613fdd218/egress-router-binary-copy/0.log"
Jul 07 23:50:35.347581 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.347556    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjztw_bd5bf802-afe5-4a9e-88ac-764613fdd218/cni-plugins/0.log"
Jul 07 23:50:35.364506 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.364483    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjztw_bd5bf802-afe5-4a9e-88ac-764613fdd218/bond-cni-plugin/0.log"
Jul 07 23:50:35.381145 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.381117    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjztw_bd5bf802-afe5-4a9e-88ac-764613fdd218/routeoverride-cni/0.log"
Jul 07 23:50:35.397890 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.397868    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjztw_bd5bf802-afe5-4a9e-88ac-764613fdd218/whereabouts-cni-bincopy/0.log"
Jul 07 23:50:35.414698 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.414677    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjztw_bd5bf802-afe5-4a9e-88ac-764613fdd218/whereabouts-cni/0.log"
Jul 07 23:50:35.762034 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.761963    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mlfz4_daf750d5-c5fc-4b4d-a9b9-8933bbdf9008/network-metrics-daemon/0.log"
Jul 07 23:50:35.775777 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:35.775752    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mlfz4_daf750d5-c5fc-4b4d-a9b9-8933bbdf9008/kube-rbac-proxy/0.log"
Jul 07 23:50:36.905980 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:36.905872    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/ovn-controller/0.log"
Jul 07 23:50:36.919063 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:36.919041    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/ovn-acl-logging/0.log"
Jul 07 23:50:36.942355 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:36.942331    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/kube-rbac-proxy-node/0.log"
Jul 07 23:50:36.959409 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:36.959376    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 23:50:36.979835 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:36.979803    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/northd/0.log"
Jul 07 23:50:36.999496 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:36.999466    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/nbdb/0.log"
Jul 07 23:50:37.017612 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:37.017578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/sbdb/0.log"
Jul 07 23:50:37.082147 ip-10-0-137-221 kubenswrapper[2581]: I0707 23:50:37.082116    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxh4z_6cd06347-bd8c-42c5-b4e6-a1aeac9e2b88/ovnkube-controller/0.log"