Jul 09 04:32:12.718976 ip-10-0-134-202 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.058774    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063952    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063967    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063971    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063974    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063979    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063984    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063987    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 04:32:13.099282 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063991    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063995    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.063998    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064001    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064005    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064008    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064010    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064013    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064016    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064018    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064021    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064047    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064050    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064054    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064058    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064061    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064064    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064066    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064069    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 04:32:13.100506 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064072    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064075    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064078    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064081    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064084    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064087    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064090    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064093    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064096    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064099    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064101    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064104    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064107    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064110    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064112    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064117    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064120    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064122    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064125    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064128    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 04:32:13.101283 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064130    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064133    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064136    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064138    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064141    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064143    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064146    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064149    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064152    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064154    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064157    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064160    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064162    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064166    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064169    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064171    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064174    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064176    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064179    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064182    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 04:32:13.102029 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064184    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064187    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064189    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064192    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064194    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064197    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064200    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064202    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064205    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064208    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064211    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064213    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064216    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064219    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064222    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064224    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064226    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064229    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064232    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064234    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 04:32:13.102784 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064242    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064246    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064249    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064252    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064255    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064258    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064262    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064266    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064269    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064272    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064275    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064277    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.064280    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065043    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065049    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065053    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065056    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065058    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065062    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065065    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 04:32:13.103667 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065067    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065070    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065073    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065076    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065079    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065081    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065084    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065086    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065089    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065091    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065094    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065097    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065102    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065105    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065107    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065112    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065116    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065119    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065122    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 04:32:13.104564 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065125    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065127    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065130    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065132    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065135    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065137    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065140    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065143    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065145    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065148    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065150    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065153    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065158    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065161    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065163    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065166    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065169    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065172    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065174    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065177    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 04:32:13.105519 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065179    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065182    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065184    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065187    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065191    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065195    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065198    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065201    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065204    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065207    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065209    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065212    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065215    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065217    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065220    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065222    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065225    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065227    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065230    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065232    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 04:32:13.106517 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065235    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065239    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065242    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065245    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065247    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065250    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065253    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065256    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065258    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065261    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065265    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065267    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065270    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065273    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065275    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065277    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065280    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065284    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065288    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 04:32:13.107516 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065292    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065295    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065298    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065301    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065303    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065306    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065309    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065312    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065315    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065317    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065320    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065322    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065325    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065327    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065737    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065742    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065745    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065748    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065751    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065754    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 04:32:13.108522 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065757    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065759    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065762    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065764    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065767    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065770    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065773    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065776    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065778    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065781    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065785    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065788    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065790    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065793    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065796    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065798    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065801    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065804    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065806    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065808    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 04:32:13.109375 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065811    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065814    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065816    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065819    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065821    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065824    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065826    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065831    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065834    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065837    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065840    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065844    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065846    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065849    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065851    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065854    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065857    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065860    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065863    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 04:32:13.110159 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065866    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065868    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065871    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065875    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065878    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065880    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065883    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065885    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065888    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065891    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065893    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065896    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065898    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065901    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065903    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065906    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065908    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065911    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065913    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065916    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 04:32:13.110987 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065918    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065921    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065923    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065926    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065930    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065933    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065935    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065937    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065940    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065942    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065945    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065947    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065951    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065954    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065958    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065963    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065967    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065969    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065972    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 04:32:13.111720 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065975    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065978    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065981    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065984    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065987    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065989    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065992    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065994    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065997    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.065999    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066002    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066004    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066007    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066009    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066011    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066125    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066137    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066149    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066154    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066164    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066167    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 04:32:13.112470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066172    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066176    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066180    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066183    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066186    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066190    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066193    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066197    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066200    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066203    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066206    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066209    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066215    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066218    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066222    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066225    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066228    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066232    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066235    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066238    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066241    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066244    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066247    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066250    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 04:32:13.113219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066253    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066256    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066260    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066263    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066267    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066270    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066273    2563 flags.go:64] FLAG: --enable-server="true"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066282    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066290    2563 flags.go:64] FLAG: --event-burst="100"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066294    2563 flags.go:64] FLAG: --event-qps="50"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066296    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066299    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066302    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066306    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066309    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066313    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066317    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066320    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066323    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066326    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066329    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066332    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066335    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066338    2563 flags.go:64] FLAG: --feature-gates=""
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066342    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 04:32:13.114376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066345    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066348    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066351    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066354    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066357    2563 flags.go:64] FLAG: --help="false"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066360    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-202.ec2.internal"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066363    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066366    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066369    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066372    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066375    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066379    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066382    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066385    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066388    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066393    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066396    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066399    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066402    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066405    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066407    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066410    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066414    2563 flags.go:64] FLAG: --lock-file=""
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066417    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 04:32:13.115465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066420    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066423    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066428    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066431    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066434    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066437    2563 flags.go:64] FLAG: --logging-format="text"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066440    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066443    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066446    2563 flags.go:64] FLAG: --manifest-url=""
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066449    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066453    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066456    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066461    2563 flags.go:64] FLAG: --max-pods="110"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066464    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066467    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066470    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066473    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066476    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066479    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066483    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066491    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066494    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066497    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 04:32:13.116205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066500    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066504    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066510    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066513    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066516    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066519    2563 flags.go:64] FLAG: --port="10250"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066522    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066526    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ba081b1abe3e661"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066530    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066533    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066536    2563 flags.go:64] FLAG: --register-node="true"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066539    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066543    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066546    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066549    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066552    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066556    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066559    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066562    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066565    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066568    2563 flags.go:64] FLAG: --runonce="false"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066570    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066573    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066577    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066579    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 04:32:13.211116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066582    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 04:32:13.133708 ip-10-0-134-202 systemd[1]: Started Kubernetes Kubelet.
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066585    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066589    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066593    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066596    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066599    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066601    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066604    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066607    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066611    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066613    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066619    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066622    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066625    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066632    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066637    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066660    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066664    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066667    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066670    2563 flags.go:64] FLAG: --v="2"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066674    2563 flags.go:64] FLAG: --version="false"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066679    2563 flags.go:64] FLAG: --vmodule=""
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066683    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.066686    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 04:32:13.212432 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066808    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066814    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066817    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066820    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066823    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066826    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066829    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066831    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066834    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066836    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066839    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066843    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066846    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066848    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066851    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066854    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066856    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066859    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066863    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066866    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 04:32:13.221996 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066869    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066872    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066875    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066879    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066883    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066886    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066889    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066892    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066895    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066898    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066901    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066904    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066907    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066909    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066912    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066915    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066917    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066920    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066922    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066925    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 04:32:13.222730 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066927    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066930    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066932    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066936    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066939    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066942    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066944    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066947    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066950    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066952    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066955    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066961    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066964    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066967    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066969    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066974    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066976    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066979    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066982    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066985    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 04:32:13.223462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066988    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066990    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066993    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066995    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.066998    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067001    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067003    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067006    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067009    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067011    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067014    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067016    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067019    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067021    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067024    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067028    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067031    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067033    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067036    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 04:32:13.224197 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067039    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067041    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067044    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067046    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067049    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067052    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067054    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067057    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067061    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067063    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067066    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067069    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067071    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067074    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067076    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067079    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067082    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067085    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067087    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 04:32:13.224932 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.067090    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.067635    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.074340    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.074362    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.074962    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.074977    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075039    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075044    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075048    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075051    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075054    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075057    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075060    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075063    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075066    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 04:32:13.225684 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075069    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075072    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075075    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075078    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075081    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075084    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075087    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075090    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075093    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075095    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075099    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075101    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075104    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075107    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075110    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075114    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075117    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075120    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075123    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075125    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 04:32:13.226428 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075129    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075132    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075134    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075137    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075139    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075142    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075144    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075147    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075149    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075153    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075157    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075160    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075162    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075165    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075168    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075171    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075174    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075176    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075179    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 04:32:13.227170 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075183    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075185    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075188    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075190    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075193    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075195    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075198    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075200    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075204    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075206    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075209    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075211    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075214    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075217    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075220    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075223    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075226    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075228    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075231    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075233    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 04:32:13.227921 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075236    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075238    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075241    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075243    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075246    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075249    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075251    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075254    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075257    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075259    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075262    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075266    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075270    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075272    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075276    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075280    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075283    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075286    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075289    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075292    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 04:32:13.228663 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075297    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075300    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075302    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075305    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075308    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075313    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075315    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075319    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075321    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075324    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075327    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.075332    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075450    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075456    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075459    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 04:32:13.229403 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075461    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075464    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075467    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075470    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075472    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075475    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075478    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075481    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075483    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075485    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075488    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075491    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075493    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075496    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075498    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075501    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075504    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075506    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075511    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075513    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 04:32:13.230164 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075516    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075518    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075522    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075525    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075527    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075531    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075533    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075537    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075541    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075543    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075546    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075549    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075551    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075553    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075556    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075558    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075561    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075563    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075566    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075568    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 04:32:13.230915 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075571    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075574    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075576    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075579    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075582    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075586    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075588    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075591    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075593    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075596    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075599    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075603    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075607    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075610    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075614    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075617    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075620    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075623    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075626    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 04:32:13.231633 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075629    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075632    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075635    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075637    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075658    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075663    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075665    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075668    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075671    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075673    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075676    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075679    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075681    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075684    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075686    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075689    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075692    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075695    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075697    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 04:32:13.232379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075700    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075702    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075704    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075707    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075711    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075714    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075716    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075719    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075723    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075726    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075729    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075731    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075734    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075737    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075739    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075742    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075744    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 04:32:13.233117 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:13.075747    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.075752    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.075880    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.079961    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.081135    2563 server.go:1019] "Starting client certificate rotation"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.081234    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.081265    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.084339    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.087572    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.095669    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.098866    2563 log.go:25] "Validated CRI v1 image API"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.099799    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 04:32:13.233900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.103313    2563 fs.go:135] Filesystem UUIDs: map[2e4b71f0-b655-4006-b9d5-7a154989935f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9b7ec0b4-53d8-411a-a95d-e87eade4805e:/dev/nvme0n1p4]
Jul 09 04:32:13.234609 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.103334    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 04:32:13.234609 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.110249    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.110529    2563 manager.go:216] Machine: {Timestamp:2026-07-09 04:32:13.108406672 +0000 UTC m=+0.268827186 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114974 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b9d082b53643b2fce75f272e1c498 SystemUUID:ec2b9d08-2b53-643b-2fce-75f272e1c498 BootID:b4a64bb7-864e-441e-b6fb-ca1253f9686f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:a7:e0:51:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:a7:e0:51:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:24:b4:16:2d:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.110703    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.110836    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.113531    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.113576    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.114348    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.114367    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.114381    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.115511    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.116826    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.120801    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.120942    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.120974    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.120989    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.121002    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.121013    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.121025    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 04:32:13.324561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.121387    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.121407    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.123324    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.127523    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.127552    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128667    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128684    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128692    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128699    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128707    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128713    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128721    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128727    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128734    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128740    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128749    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.128754    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.129038    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7pt2"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.129333    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.129342    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.130566    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.130567    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.132794    2563 server.go:1268] "Started kubelet"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.132825    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.132869    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.132936    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.134707    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.136621    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7pt2"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.136727    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.139308    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.140577    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.140584    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-202.ec2.internal.18c084dc0fdd1870  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-202.ec2.internal,UID:ip-10-0-134-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-202.ec2.internal,},FirstTimestamp:2026-07-09 04:32:13.13253592 +0000 UTC m=+0.292956431,LastTimestamp:2026-07-09 04:32:13.13253592 +0000 UTC m=+0.292956431,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-202.ec2.internal,}"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.141736    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.141741    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.141800    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.142267    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.142282    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.142267    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.142379    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.142385    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 04:32:13.328665 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.142816    2563 factory.go:55] Registering systemd factory
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.142832    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.143062    2563 factory.go:153] Registering CRI-O factory
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.143079    2563 factory.go:223] Registration of the crio container factory successfully
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.143129    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.143152    2563 factory.go:103] Registering Raw factory
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.143166    2563 manager.go:1196] Started watching for new ooms in manager
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.143661    2563 manager.go:349] Starting recovery of all containers
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.151278    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.153831    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-202.ec2.internal\" not found" node="ip-10-0-134-202.ec2.internal"
Jul 09 04:32:13.329779 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.241928    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:13.430134 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.342207    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:13.541174 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.442504    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:13.544384 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.542864    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:13.656492 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.643816    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:13.769169 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.744401    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:13.885877 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.845018    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.003114 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:13.945746    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.003114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:13.952146    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 04:32:14.127214 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.046744    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.127214 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.081012    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 04:32:14.127214 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.081238    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 04:32:14.127214 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.081237    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 04:32:14.127214 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.121506    2563 apiserver.go:52] "Watching apiserver"
Jul 09 04:32:14.145428 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.142303    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 04:27:13 +0000 UTC" deadline="2028-01-14 21:07:00.239309225 +0000 UTC"
Jul 09 04:32:14.145428 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.142338    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13312h34m46.096976831s"
Jul 09 04:32:14.148636 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.147676    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.254091 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.248252    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.374465 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.348927    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.374465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.373689    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 04:32:14.382612 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.379449    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 04:32:14.382612 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.382234    2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-202.ec2.internal" not found
Jul 09 04:32:14.488170 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.398905    2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-202.ec2.internal" not found
Jul 09 04:32:14.488170 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.449312    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.488170 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.456660    2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-202.ec2.internal" not found
Jul 09 04:32:14.550074 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.550050    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.588354 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.588327    2563 manager.go:354] Recovery completed
Jul 09 04:32:14.593307 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.593290    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.595759 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.595731    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.595883 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.595771    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.595883 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.595787    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.596486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.596463    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 04:32:14.596486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.596483    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 04:32:14.596612 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.596504    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 04:32:14.596612 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.596470    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.597389 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.597374    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.597467 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.597401    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.597467 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.597412    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.598874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.598862    2563 policy_none.go:49] "None policy: Start"
Jul 09 04:32:14.598912 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.598879    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 04:32:14.598912 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.598890    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 04:32:14.601063 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.601048    2563 policy_none.go:47] "Start"
Jul 09 04:32:14.644658 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.644424    2563 manager.go:337] "Starting Device Plugin manager"
Jul 09 04:32:14.644805 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.644713    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 04:32:14.644805 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.644726    2563 server.go:87] "Starting device plugin registration server"
Jul 09 04:32:14.645026 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.645011    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 04:32:14.645100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.645027    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 04:32:14.645333 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.645189    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 04:32:14.645333 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.645278    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 04:32:14.645333 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.645287    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 04:32:14.646007 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.645985    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 04:32:14.646117 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.646044    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.693794 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.693751    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 04:32:14.696245 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.695050    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 04:32:14.696245 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.695090    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 04:32:14.696245 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.695118    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 04:32:14.696245 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.695157    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 04:32:14.698242 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.698220    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 04:32:14.737964 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.737892    2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-202.ec2.internal" not found
Jul 09 04:32:14.737964 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.737922    2563 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-202.ec2.internal" not found
Jul 09 04:32:14.745775 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.745754    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.746768 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.746748    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.746874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.746785    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.746874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.746799    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.746874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.746824    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.754863 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.754841    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.754929 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.754876    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-202.ec2.internal\": node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.765524 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.765498    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.795566 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.795529    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"]
Jul 09 04:32:14.795762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.795625    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.796645 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.796628    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.796762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.796674    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.796762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.796689    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.799250 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.799236    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.799363 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.799349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.799406 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.799382    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.800196 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.800175    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.800274 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.800214    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.800274 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.800225    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.800274 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.800181    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.800401 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.800290    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.800401 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.800304    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.802757 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.802743    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=[]
Jul 09 04:32:14.802815 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.802760    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-nztfk"]
Jul 09 04:32:14.802853 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.802825    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.802853 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.802844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.802927 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.802872    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.803694 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.803658    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.803823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.803706    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.803823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.803724    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.803823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.803725    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.803823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.803749    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.803823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.803760    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.806271 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.806255    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"]
Jul 09 04:32:14.806387 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.806375    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.806429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.806377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.806470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.806437    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.809018 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.809000    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.809098 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.809031    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.809098 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.809042    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.809098 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.809001    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.809253 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.809108    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.809253 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.809120    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.811441 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.811425    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-9xq6x"]
Jul 09 04:32:14.811555 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.811540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.811610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.811575    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.811664 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.811576    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.812335 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812319    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 04:32:14.812408 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812319    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 04:32:14.812408 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812356    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 04:32:14.812567 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812544    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.812567 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812553    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.812666 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812578    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.812666 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812594    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.812666 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812629    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.812839 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812669    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.812896 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.812841    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lgtgv\""
Jul 09 04:32:14.815135 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815120    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-n8pz9"]
Jul 09 04:32:14.815207 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815196    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.815271 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:14.815271 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815266    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.815389 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815284    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 04:32:14.815389 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815336    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 04:32:14.815495 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815398    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 04:32:14.815495 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815411    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8lkvv\""
Jul 09 04:32:14.816015 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.815999    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.816100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.816021    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.816100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.816031    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.816100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.816063    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.816100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.816079    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.816100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.816089    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.816100 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.816088    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:14.818540 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.818526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.818601 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.818550    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.819267 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.819251    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.819349 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.819282    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.819349 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.819299    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.819518 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.819494    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-202.ec2.internal\" not found" node="ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.821981 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.821957    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g988b\""
Jul 09 04:32:14.822093 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.821999    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 04:32:14.822362 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.822345    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 04:32:14.824850 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.824832    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-202.ec2.internal\" not found" node="ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.838380 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.838299    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qp2h6"]
Jul 09 04:32:14.838560 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.838542    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.839746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.839716    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.839884 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.839759    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.839884 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.839775    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.842531 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.842510    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-vbmds"]
Jul 09 04:32:14.842629 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.842597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.842629 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.842628    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.842800 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.842788    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.843063 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.843047    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 04:32:14.843548 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.843529    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.843636 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.843561    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.843636 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.843572    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.843636 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.843536    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.843636 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.843626    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.843869 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.843643    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.846192 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.846297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846210    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.846297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846262    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 04:32:14.846381 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 04:32:14.846610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846595    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 04:32:14.846651 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846640    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mscgq\""
Jul 09 04:32:14.846776 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846760    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 04:32:14.847007 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.846992    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.847056 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.847019    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.847056 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.847033    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.849615 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.849596    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bqtmb\""
Jul 09 04:32:14.849615 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.849609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 04:32:14.849787 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.849702    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 04:32:14.851041 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.851018    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 04:32:14.851041 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.851030    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 04:32:14.851190 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.851065    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 04:32:14.851190 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.851077    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 04:32:14.852314 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b12aea9bf8b99530f8679e8c6d1d16c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-202.ec2.internal\" (UID: \"4b12aea9bf8b99530f8679e8c6d1d16c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.852363 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-device-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.852363 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-k8s-cni-cncf-io\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.852450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-ovn\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.852450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrmpq\" (UniqueName: \"kubernetes.io/projected/8b6d99d6-c66b-4f69-b031-1057b114de77-kube-api-access-vrmpq\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.852450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.852549 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-host\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.852549 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-conf-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.852549 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.852673 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:14.852673 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysconfig\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.852768 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-etc-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.852768 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-kubernetes\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.852768 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84lt\" (UniqueName: \"kubernetes.io/projected/dee135cd-d92f-4d0b-8214-ad8892e32c8c-kube-api-access-g84lt\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.852876 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxz8w\" (UniqueName: \"kubernetes.io/projected/eebfdc3d-3f5e-476e-bfce-a74a767fd682-kube-api-access-sxz8w\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.852876 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-tuned\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.852876 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-socket-dir-parent\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.852876 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-node-log\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853016 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-ovnkube-script-lib\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853016 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-etc-selinux\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.853016 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysctl-d\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.853016 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-cni-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853016 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.852986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-cni-multus\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853016 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-cni-bin\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6ndp\" (UniqueName: \"kubernetes.io/projected/cd6926db-2043-40d5-b6db-961112476d84-kube-api-access-j6ndp\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b6d99d6-c66b-4f69-b031-1057b114de77-iptables-alerter-script\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b6d99d6-c66b-4f69-b031-1057b114de77-host-slash\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-systemd\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-var-lib-kubelet\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-cnibin\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-lib-modules\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.853218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee135cd-d92f-4d0b-8214-ad8892e32c8c-tmp\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-multus-certs\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-log-socket\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-os-release\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-cni-bin\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-var-lib-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-socket-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-registration-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3550305-0add-4db7-a0a5-8e307aa0b18e-cni-binary-copy\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-etc-kubernetes\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-slash\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-env-overrides\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysctl-conf\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-run-netns\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.853544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-ovnkube-config\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ee03c06c928493e4823bc059365a1f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal\" (UID: \"3ee03c06c928493e4823bc059365a1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-run\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-sys\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-netns\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-systemd\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ee03c06c928493e4823bc059365a1f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal\" (UID: \"3ee03c06c928493e4823bc059365a1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-system-cni-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-kubelet\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hpg\" (UniqueName: \"kubernetes.io/projected/b3550305-0add-4db7-a0a5-8e307aa0b18e-kube-api-access-59hpg\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-sys-fs\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-daemon-config\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-systemd-units\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-cni-netd\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd6926db-2043-40d5-b6db-961112476d84-ovn-node-metrics-cert\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-modprobe-d\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.854114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-hostroot\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.854634 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.853925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-kubelet\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.864960 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.864941    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-z2mdq"]
Jul 09 04:32:14.865104 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.865094    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.865649 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.865628    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.866157 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.866139    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.866264 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.866175    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.866264 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.866190    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.868864 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.868846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:14.868967 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.868881    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.869810 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.869788    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.869940 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.869822    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.869940 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.869835    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.871367 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.871350    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-wcn82"]
Jul 09 04:32:14.871679 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.871664    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.872886 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.872863    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 04:32:14.873011 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.872896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w2fr6\""
Jul 09 04:32:14.873011 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.872942    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 04:32:14.873011 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.872990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 04:32:14.873186 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.873125    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.873186 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.873152    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.873186 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.873168    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.875835 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.875818    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.875935 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.875855    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.876654 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.876640    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.876751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.876680    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.876751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.876702    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.879364 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.879344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 04:32:14.879558 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.879542    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 04:32:14.879640 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.879548    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m4kmm\""
Jul 09 04:32:14.890542 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.890514    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-h9dcr"]
Jul 09 04:32:14.890762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.890750    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.891745 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.891722    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.891851 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.891762    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.891851 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.891783    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.894484 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.894468    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mpvjz"]
Jul 09 04:32:14.894626 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.894609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:14.894681 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.894651    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.894723 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.894651    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.895539 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.895521    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.895623 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.895550    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.895623 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.895561    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.895623 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.895523    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.895762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.895635    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.895762 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.895648    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:14.895762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.895664    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.898229 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.898215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:14.898298 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.898243    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.899905 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.899890    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.899964 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.899916    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.899964 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.899929    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.902479 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.902464    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 04:32:14.902766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.902748    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 04:32:14.902848 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.902799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j7r9m\""
Jul 09 04:32:14.910991 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.910962    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-mkhc4"]
Jul 09 04:32:14.911238 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.911225    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.912177 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.912157    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.912301 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.912193    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.912301 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.912214    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.914944 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.914924    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qcr2r"]
Jul 09 04:32:14.915063 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.915048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:14.915101 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.915084    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.915146 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.915134    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.915973 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.915956    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.916048 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.915989    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.916048 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.916000    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.916048 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.915958    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.916151 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.916064    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.916151 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.916077    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.916220 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.916210    2563 predicate.go:218] "Predicate failed on Pod" pod="kube-system/global-pull-secret-syncer-qcr2r" err="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector"
Jul 09 04:32:14.916261 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.916220    2563 allocation_manager.go:702] "Pod admission denied" podUID="0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec" pod="kube-system/global-pull-secret-syncer-qcr2r" reason="NodeAffinity" message="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector"
Jul 09 04:32:14.918904 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.918884    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 04:32:14.918960 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.918946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rcs2\""
Jul 09 04:32:14.919002 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.918980    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 04:32:14.955020 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.954993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ee03c06c928493e4823bc059365a1f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal\" (UID: \"3ee03c06c928493e4823bc059365a1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-system-cni-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-kubelet\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hpg\" (UniqueName: \"kubernetes.io/projected/b3550305-0add-4db7-a0a5-8e307aa0b18e-kube-api-access-59hpg\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a58c8-35e2-4fd6-b0ba-8849c606fe43-konnectivity-ca\") pod \"konnectivity-agent-mpvjz\" (UID: \"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43\") " pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-sys-fs\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955117    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ee03c06c928493e4823bc059365a1f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal\" (UID: \"3ee03c06c928493e4823bc059365a1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-daemon-config\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955138    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-kubelet\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-systemd-units\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-cni-netd\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd6926db-2043-40d5-b6db-961112476d84-ovn-node-metrics-cert\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955209    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-system-cni-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsg6w\" (UniqueName: \"kubernetes.io/projected/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-kube-api-access-gsg6w\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-cni-netd\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955273    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-systemd-units\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955295    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f4a58c8-35e2-4fd6-b0ba-8849c606fe43-agent-certs\") pod \"konnectivity-agent-mpvjz\" (UID: \"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43\") " pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955324    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955290    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-sys-fs\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-modprobe-d\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-hostroot\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-kubelet\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b12aea9bf8b99530f8679e8c6d1d16c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-202.ec2.internal\" (UID: \"4b12aea9bf8b99530f8679e8c6d1d16c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955525    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-hostroot\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955534    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-kubelet\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-device-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.955644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-modprobe-d\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955571    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b12aea9bf8b99530f8679e8c6d1d16c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-202.ec2.internal\" (UID: \"4b12aea9bf8b99530f8679e8c6d1d16c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955587    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-device-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-k8s-cni-cncf-io\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-ovn\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-k8s-cni-cncf-io\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-serviceca\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-system-cni-dir\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955687    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-ovn\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrmpq\" (UniqueName: \"kubernetes.io/projected/8b6d99d6-c66b-4f69-b031-1057b114de77-kube-api-access-vrmpq\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-daemon-config\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-host\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-conf-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955859    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955862    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-conf-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955868    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-host\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.956620 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-os-release\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955924    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysconfig\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955907    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-etc-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955986    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.955984    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysconfig\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-kubernetes\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956018    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-etc-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g84lt\" (UniqueName: \"kubernetes.io/projected/dee135cd-d92f-4d0b-8214-ad8892e32c8c-kube-api-access-g84lt\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956057    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-kubernetes\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-hosts-file\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956107    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-dbus\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxz8w\" (UniqueName: \"kubernetes.io/projected/eebfdc3d-3f5e-476e-bfce-a74a767fd682-kube-api-access-sxz8w\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-tuned\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.957529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-socket-dir-parent\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-node-log\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956260    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-ovnkube-script-lib\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956330    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-etc-selinux\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956381    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-etc-selinux\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysctl-d\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-cni-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-cni-multus\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956466    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-node-log\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-cni-bin\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956477    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysctl-d\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6ndp\" (UniqueName: \"kubernetes.io/projected/cd6926db-2043-40d5-b6db-961112476d84-kube-api-access-j6ndp\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956535    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-cni-dir\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956550    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-multus-socket-dir-parent\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b6d99d6-c66b-4f69-b031-1057b114de77-iptables-alerter-script\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956591    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-cni-multus\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956615    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-cni-bin\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.958425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b6d99d6-c66b-4f69-b031-1057b114de77-host-slash\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-systemd\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-var-lib-kubelet\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-cnibin\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956694    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b6d99d6-c66b-4f69-b031-1057b114de77-host-slash\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956853    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956965    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-cnibin\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957021    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkxjs\" (UniqueName: \"kubernetes.io/projected/f06f6d0f-a855-4390-82d8-0f739bc00705-kube-api-access-zkxjs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957055    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957063    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957076    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957112    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957025    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-var-lib-kubelet\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957154    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957180    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957184    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957199    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957208    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957222    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957225    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b6d99d6-c66b-4f69-b031-1057b114de77-iptables-alerter-script\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.959416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.956911    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-systemd\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957177    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-lib-modules\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957290    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957299    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-ovnkube-script-lib\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957314    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957318    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957335    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957368    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957399    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-lib-modules\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957781    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957808    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957837    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957993    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958017    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958034    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958042    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee135cd-d92f-4d0b-8214-ad8892e32c8c-tmp\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.957991    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958155    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958172    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958193    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-multus-certs\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-log-socket\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958640    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-multus-certs\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.960562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-cnibin\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-log-socket\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-os-release\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-cni-bin\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958963    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958968    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-os-release\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958984    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958997    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-var-lib-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.958995    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-var-lib-cni-bin\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959000    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-var-lib-openvswitch\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jjqd\" (UniqueName: \"kubernetes.io/projected/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-kube-api-access-9jjqd\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-kubelet-config\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-socket-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-host\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-registration-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.961823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3550305-0add-4db7-a0a5-8e307aa0b18e-cni-binary-copy\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-socket-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-etc-kubernetes\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-slash\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959476    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eebfdc3d-3f5e-476e-bfce-a74a767fd682-registration-dir\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-env-overrides\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959523    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-etc-kubernetes\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-tmp-dir\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959525    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-slash\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysctl-conf\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-run-netns\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-ovnkube-config\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959665    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-host-run-netns\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959745    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ee03c06c928493e4823bc059365a1f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal\" (UID: \"3ee03c06c928493e4823bc059365a1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959747    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-sysctl-conf\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ee03c06c928493e4823bc059365a1f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal\" (UID: \"3ee03c06c928493e4823bc059365a1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-run\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.962523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-sys\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-netns\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-systemd\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959895    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-run\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb79m\" (UniqueName: \"kubernetes.io/projected/505231a1-3c45-41aa-8290-bd70ff742a2c-kube-api-access-jb79m\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959944    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3550305-0add-4db7-a0a5-8e307aa0b18e-host-run-netns\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd6926db-2043-40d5-b6db-961112476d84-run-systemd\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.959996    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-env-overrides\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.960036    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dee135cd-d92f-4d0b-8214-ad8892e32c8c-sys\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.960051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3550305-0add-4db7-a0a5-8e307aa0b18e-cni-binary-copy\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.960194    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.960302    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd6926db-2043-40d5-b6db-961112476d84-ovnkube-config\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.961821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dee135cd-d92f-4d0b-8214-ad8892e32c8c-etc-tuned\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.961866    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee135cd-d92f-4d0b-8214-ad8892e32c8c-tmp\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.963090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.961913    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd6926db-2043-40d5-b6db-961112476d84-ovn-node-metrics-cert\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.965747 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.965727    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:14.969563 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.969294    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 04:32:14.969563 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.969340    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 04:32:14.969563 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.969359    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wbx9g for pod openshift-network-diagnostics/network-check-target-9xq6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:14.969563 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:14.969537    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g podName:00e26342-a654-48f1-8995-722ddde2c54c nodeName:}" failed. No retries permitted until 2026-07-09 04:32:15.469498154 +0000 UTC m=+2.629918678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wbx9g" (UniqueName: "kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g") pod "network-check-target-9xq6x" (UID: "00e26342-a654-48f1-8995-722ddde2c54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:14.971810 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.971780    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrmpq\" (UniqueName: \"kubernetes.io/projected/8b6d99d6-c66b-4f69-b031-1057b114de77-kube-api-access-vrmpq\") pod \"iptables-alerter-nztfk\" (UID: \"8b6d99d6-c66b-4f69-b031-1057b114de77\") " pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:14.971947 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.971854    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxz8w\" (UniqueName: \"kubernetes.io/projected/eebfdc3d-3f5e-476e-bfce-a74a767fd682-kube-api-access-sxz8w\") pod \"aws-ebs-csi-driver-node-wkjrb\" (UID: \"eebfdc3d-3f5e-476e-bfce-a74a767fd682\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:14.972113 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.972089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84lt\" (UniqueName: \"kubernetes.io/projected/dee135cd-d92f-4d0b-8214-ad8892e32c8c-kube-api-access-g84lt\") pod \"tuned-n8pz9\" (UID: \"dee135cd-d92f-4d0b-8214-ad8892e32c8c\") " pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:14.972175 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.972093    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6ndp\" (UniqueName: \"kubernetes.io/projected/cd6926db-2043-40d5-b6db-961112476d84-kube-api-access-j6ndp\") pod \"ovnkube-node-vbmds\" (UID: \"cd6926db-2043-40d5-b6db-961112476d84\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:14.972903 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:14.972882    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hpg\" (UniqueName: \"kubernetes.io/projected/b3550305-0add-4db7-a0a5-8e307aa0b18e-kube-api-access-59hpg\") pod \"multus-qp2h6\" (UID: \"b3550305-0add-4db7-a0a5-8e307aa0b18e\") " pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:15.060869 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.060778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a58c8-35e2-4fd6-b0ba-8849c606fe43-konnectivity-ca\") pod \"konnectivity-agent-mpvjz\" (UID: \"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43\") " pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:15.060869 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.060818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsg6w\" (UniqueName: \"kubernetes.io/projected/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-kube-api-access-gsg6w\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:15.060869 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.060835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f4a58c8-35e2-4fd6-b0ba-8849c606fe43-agent-certs\") pod \"konnectivity-agent-mpvjz\" (UID: \"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43\") " pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:15.060869 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.060858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.060891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-serviceca\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.060950    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.060955    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-system-cni-dir\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-os-release\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-hosts-file\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061116    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-system-cni-dir\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-dbus\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061193    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-os-release\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061195    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-hosts-file\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkxjs\" (UniqueName: \"kubernetes.io/projected/f06f6d0f-a855-4390-82d8-0f739bc00705-kube-api-access-zkxjs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-cnibin\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.061289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061342    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jjqd\" (UniqueName: \"kubernetes.io/projected/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-kube-api-access-9jjqd\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061345    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-kubelet-config\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061410    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-dbus\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061410    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-serviceca\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061483    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061494    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061542    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a58c8-35e2-4fd6-b0ba-8849c606fe43-konnectivity-ca\") pod \"konnectivity-agent-mpvjz\" (UID: \"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43\") " pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061484    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/505231a1-3c45-41aa-8290-bd70ff742a2c-cnibin\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061568    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061735    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061747    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-kubelet-config\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-host\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-tmp-dir\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061833    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-host\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb79m\" (UniqueName: \"kubernetes.io/projected/505231a1-3c45-41aa-8290-bd70ff742a2c-kube-api-access-jb79m\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.062746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.061972    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-tmp-dir\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062096    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062170    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/505231a1-3c45-41aa-8290-bd70ff742a2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062238    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062269    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062284    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062242    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062350    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062370    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062464    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062487    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062492    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062525    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062544    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062559    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062582    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062597    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062498    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062661    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062676    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.062700    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.062787    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret podName:0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec nodeName:}" failed. No retries permitted until 2026-07-09 04:32:15.562763453 +0000 UTC m=+2.723183973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret") pod "global-pull-secret-syncer-qcr2r" (UID: "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062500    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.062830    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.062885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs podName:f06f6d0f-a855-4390-82d8-0f739bc00705 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:15.562864332 +0000 UTC m=+2.723284854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs") pod "network-metrics-daemon-h9dcr" (UID: "f06f6d0f-a855-4390-82d8-0f739bc00705") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062889    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062942    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.063489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.062956    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.064971 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.064950    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f4a58c8-35e2-4fd6-b0ba-8849c606fe43-agent-certs\") pod \"konnectivity-agent-mpvjz\" (UID: \"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43\") " pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:15.066833 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.066816    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.069044 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.068998    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qcr2r" podStartSLOduration=0.068984865 podStartE2EDuration="68.984865ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:15.068350783 +0000 UTC m=+2.228771300" watchObservedRunningTime="2026-07-09 04:32:15.068984865 +0000 UTC m=+2.229405388"
Jul 09 04:32:15.075505 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.075472    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsg6w\" (UniqueName: \"kubernetes.io/projected/450323ce-9fff-4a9a-8b3f-a5855a14ec9b-kube-api-access-gsg6w\") pod \"node-ca-z2mdq\" (UID: \"450323ce-9fff-4a9a-8b3f-a5855a14ec9b\") " pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:15.075806 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.075784    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb79m\" (UniqueName: \"kubernetes.io/projected/505231a1-3c45-41aa-8290-bd70ff742a2c-kube-api-access-jb79m\") pod \"multus-additional-cni-plugins-wcn82\" (UID: \"505231a1-3c45-41aa-8290-bd70ff742a2c\") " pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.075898 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.075881    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jjqd\" (UniqueName: \"kubernetes.io/projected/2ef6d9a9-70fa-4853-a69c-bf8a3801895d-kube-api-access-9jjqd\") pod \"node-resolver-mkhc4\" (UID: \"2ef6d9a9-70fa-4853-a69c-bf8a3801895d\") " pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:15.076174 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.076156    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkxjs\" (UniqueName: \"kubernetes.io/projected/f06f6d0f-a855-4390-82d8-0f739bc00705-kube-api-access-zkxjs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:15.122988 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.122950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:15.127401 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.127366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:15.156109 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.156071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nztfk"
Jul 09 04:32:15.167942 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.167915    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.171243 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.171217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb"
Jul 09 04:32:15.193494 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.193462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8pz9"
Jul 09 04:32:15.197540 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.197513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qp2h6"
Jul 09 04:32:15.213579 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.213547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:15.226231 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.226197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z2mdq"
Jul 09 04:32:15.252453 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.252414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wcn82"
Jul 09 04:32:15.268935 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.268909    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.272383 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.272366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:15.284395 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.284371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mkhc4"
Jul 09 04:32:15.369217 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.369128    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.469310 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.469270    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.566673 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.566630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:15.566837 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.566694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:15.566837 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.566727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:15.566837 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.566785    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.566837 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.566797    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.566837 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.566811    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 04:32:15.567940 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.567921    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.568080 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.567958    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.568080 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.567972    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.568080 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.567921    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.568080 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.568030    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.568080 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.568042    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.567921    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568168    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.568177    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.568191    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeHasSufficientPID"
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568196    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568226    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret podName:0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec nodeName:}" failed. No retries permitted until 2026-07-09 04:32:16.568206119 +0000 UTC m=+3.728626621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret") pod "global-pull-secret-syncer-qcr2r" (UID: "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568248    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs podName:f06f6d0f-a855-4390-82d8-0f739bc00705 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:16.568236486 +0000 UTC m=+3.728656992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs") pod "network-metrics-daemon-h9dcr" (UID: "f06f6d0f-a855-4390-82d8-0f739bc00705") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568288    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 04:32:15.568297 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568302    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 04:32:15.568585 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568311    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wbx9g for pod openshift-network-diagnostics/network-check-target-9xq6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:15.568585 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.568352    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g podName:00e26342-a654-48f1-8995-722ddde2c54c nodeName:}" failed. No retries permitted until 2026-07-09 04:32:16.56833937 +0000 UTC m=+3.728759870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbx9g" (UniqueName: "kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g") pod "network-check-target-9xq6x" (UID: "00e26342-a654-48f1-8995-722ddde2c54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:15.570213 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.570195    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.671412 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.671338    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.772092 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.772056    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.797096 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.797048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6926db_2043_40d5_b6db_961112476d84.slice/crio-9812338ca9e02f5c2f5783f61f23b27a3b33cb3c3ebb556b1766f215134b2831 WatchSource:0}: Error finding container 9812338ca9e02f5c2f5783f61f23b27a3b33cb3c3ebb556b1766f215134b2831: Status 404 returned error can't find the container with id 9812338ca9e02f5c2f5783f61f23b27a3b33cb3c3ebb556b1766f215134b2831
Jul 09 04:32:15.797762 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.797714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4a58c8_35e2_4fd6_b0ba_8849c606fe43.slice/crio-f647d7e70582de6faafa1816393705315defdea37b7f5dda49d063608ac43b7d WatchSource:0}: Error finding container f647d7e70582de6faafa1816393705315defdea37b7f5dda49d063608ac43b7d: Status 404 returned error can't find the container with id f647d7e70582de6faafa1816393705315defdea37b7f5dda49d063608ac43b7d
Jul 09 04:32:15.804680 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:15.804662    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:32:15.810814 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.810786    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee03c06c928493e4823bc059365a1f8.slice/crio-4e832cd4ae66aacb497bc36006584f1d2cfa63823feed754c408434db8a969d8 WatchSource:0}: Error finding container 4e832cd4ae66aacb497bc36006584f1d2cfa63823feed754c408434db8a969d8: Status 404 returned error can't find the container with id 4e832cd4ae66aacb497bc36006584f1d2cfa63823feed754c408434db8a969d8
Jul 09 04:32:15.835200 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.835168    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebfdc3d_3f5e_476e_bfce_a74a767fd682.slice/crio-5cad428ecd86b13c9ff062e05288fb9efa4622fa61fd7f13d4a50e0bbc52865a WatchSource:0}: Error finding container 5cad428ecd86b13c9ff062e05288fb9efa4622fa61fd7f13d4a50e0bbc52865a: Status 404 returned error can't find the container with id 5cad428ecd86b13c9ff062e05288fb9efa4622fa61fd7f13d4a50e0bbc52865a
Jul 09 04:32:15.859317 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.859284    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b12aea9bf8b99530f8679e8c6d1d16c.slice/crio-812092b30a31cd040437d1528e48169ecf8cb3da03c946e00e2976aa962f9261 WatchSource:0}: Error finding container 812092b30a31cd040437d1528e48169ecf8cb3da03c946e00e2976aa962f9261: Status 404 returned error can't find the container with id 812092b30a31cd040437d1528e48169ecf8cb3da03c946e00e2976aa962f9261
Jul 09 04:32:15.872579 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.872554    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.879071 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.879037    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505231a1_3c45_41aa_8290_bd70ff742a2c.slice/crio-55267d2d378ffbf85682393f75209b40b71d57445fe92909029550171bef47eb WatchSource:0}: Error finding container 55267d2d378ffbf85682393f75209b40b71d57445fe92909029550171bef47eb: Status 404 returned error can't find the container with id 55267d2d378ffbf85682393f75209b40b71d57445fe92909029550171bef47eb
Jul 09 04:32:15.931732 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.931688    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6d99d6_c66b_4f69_b031_1057b114de77.slice/crio-fe593c3c516d0089bf5de4fd34095bdebf03a84cf670b4d9daf477998aab6d3b WatchSource:0}: Error finding container fe593c3c516d0089bf5de4fd34095bdebf03a84cf670b4d9daf477998aab6d3b: Status 404 returned error can't find the container with id fe593c3c516d0089bf5de4fd34095bdebf03a84cf670b4d9daf477998aab6d3b
Jul 09 04:32:15.972917 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:15.972880    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:15.981457 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:15.981418    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef6d9a9_70fa_4853_a69c_bf8a3801895d.slice/crio-b40d27bc0b554a507e9efeb15de46117c6e92446ecd5dac63bb2ecb30c26c4f3 WatchSource:0}: Error finding container b40d27bc0b554a507e9efeb15de46117c6e92446ecd5dac63bb2ecb30c26c4f3: Status 404 returned error can't find the container with id b40d27bc0b554a507e9efeb15de46117c6e92446ecd5dac63bb2ecb30c26c4f3
Jul 09 04:32:16.072997 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.072958    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:16.081858 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:16.081809    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450323ce_9fff_4a9a_8b3f_a5855a14ec9b.slice/crio-9c5353b92a4d4632454b6be1412fd399c541077888822c36d9824105eaa88948 WatchSource:0}: Error finding container 9c5353b92a4d4632454b6be1412fd399c541077888822c36d9824105eaa88948: Status 404 returned error can't find the container with id 9c5353b92a4d4632454b6be1412fd399c541077888822c36d9824105eaa88948
Jul 09 04:32:16.173067 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.173024    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:16.273955 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.273920    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:16.374693 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.374657    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-202.ec2.internal\" not found"
Jul 09 04:32:16.432771 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.432737    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 04:32:16.442919 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.442878    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:16.459740 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.455006    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 04:32:16.462190 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.461897    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal"]
Jul 09 04:32:16.462912 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.462532    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"
Jul 09 04:32:16.486357 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.486251    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 04:32:16.487301 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.487259    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal"]
Jul 09 04:32:16.587942 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.587847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:16.587942 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.587928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:16.588183 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.587966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:16.588183 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.588131    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:16.588297 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.588218    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret podName:0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec nodeName:}" failed. No retries permitted until 2026-07-09 04:32:18.58817978 +0000 UTC m=+5.748600298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret") pod "global-pull-secret-syncer-qcr2r" (UID: "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:16.588714 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.588689    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 04:32:16.588844 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.588748    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 04:32:16.588844 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.588778    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wbx9g for pod openshift-network-diagnostics/network-check-target-9xq6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:16.588844 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.588834    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g podName:00e26342-a654-48f1-8995-722ddde2c54c nodeName:}" failed. No retries permitted until 2026-07-09 04:32:18.588817034 +0000 UTC m=+5.749237540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbx9g" (UniqueName: "kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g") pod "network-check-target-9xq6x" (UID: "00e26342-a654-48f1-8995-722ddde2c54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:16.589018 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.588941    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:16.589018 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.589005    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs podName:f06f6d0f-a855-4390-82d8-0f739bc00705 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:18.588968961 +0000 UTC m=+5.749389475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs") pod "network-metrics-daemon-h9dcr" (UID: "f06f6d0f-a855-4390-82d8-0f739bc00705") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:16.703996 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.703464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:16.703996 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.703622    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:16.703996 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.703767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:16.703996 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:16.703877    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:16.706378 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.706325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal" event={"ID":"3ee03c06c928493e4823bc059365a1f8","Type":"ContainerStarted","Data":"4e832cd4ae66aacb497bc36006584f1d2cfa63823feed754c408434db8a969d8"}
Jul 09 04:32:16.709676 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.709629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mpvjz" event={"ID":"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43","Type":"ContainerStarted","Data":"f647d7e70582de6faafa1816393705315defdea37b7f5dda49d063608ac43b7d"}
Jul 09 04:32:16.712696 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.712666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"9812338ca9e02f5c2f5783f61f23b27a3b33cb3c3ebb556b1766f215134b2831"}
Jul 09 04:32:16.715962 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.715886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z2mdq" event={"ID":"450323ce-9fff-4a9a-8b3f-a5855a14ec9b","Type":"ContainerStarted","Data":"9c5353b92a4d4632454b6be1412fd399c541077888822c36d9824105eaa88948"}
Jul 09 04:32:16.719057 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.719026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nztfk" event={"ID":"8b6d99d6-c66b-4f69-b031-1057b114de77","Type":"ContainerStarted","Data":"fe593c3c516d0089bf5de4fd34095bdebf03a84cf670b4d9daf477998aab6d3b"}
Jul 09 04:32:16.721413 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.721382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerStarted","Data":"55267d2d378ffbf85682393f75209b40b71d57445fe92909029550171bef47eb"}
Jul 09 04:32:16.728882 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.728847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb" event={"ID":"eebfdc3d-3f5e-476e-bfce-a74a767fd682","Type":"ContainerStarted","Data":"5cad428ecd86b13c9ff062e05288fb9efa4622fa61fd7f13d4a50e0bbc52865a"}
Jul 09 04:32:16.732590 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.732514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mkhc4" event={"ID":"2ef6d9a9-70fa-4853-a69c-bf8a3801895d","Type":"ContainerStarted","Data":"b40d27bc0b554a507e9efeb15de46117c6e92446ecd5dac63bb2ecb30c26c4f3"}
Jul 09 04:32:16.740116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.740086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal" event={"ID":"4b12aea9bf8b99530f8679e8c6d1d16c","Type":"ContainerStarted","Data":"812092b30a31cd040437d1528e48169ecf8cb3da03c946e00e2976aa962f9261"}
Jul 09 04:32:16.789439 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.789393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-dbus\") pod \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") "
Jul 09 04:32:16.789652 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.789492    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-kubelet-config\") pod \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") "
Jul 09 04:32:16.789814 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.789779    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-kubelet-config" (OuterVolumeSpecName: "kubelet-config") pod "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec" (UID: "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec"). InnerVolumeSpecName "kubelet-config". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 09 04:32:16.789893 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.789795    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-dbus" (OuterVolumeSpecName: "dbus") pod "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec" (UID: "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec"). InnerVolumeSpecName "dbus". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 09 04:32:16.891245 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.891114    2563 reconciler_common.go:299] "Volume detached for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-dbus\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:32:16.891245 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:16.891150    2563 reconciler_common.go:299] "Volume detached for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-kubelet-config\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:32:17.143095 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:17.143011    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 04:32:17.153955 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:17.153914    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 04:32:17.164462 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:17.164319    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee135cd_d92f_4d0b_8214_ad8892e32c8c.slice/crio-c42ee4852aea31a67202ea33b8dd7a8fbec5778f536d7c28018f14721d891514 WatchSource:0}: Error finding container c42ee4852aea31a67202ea33b8dd7a8fbec5778f536d7c28018f14721d891514: Status 404 returned error can't find the container with id c42ee4852aea31a67202ea33b8dd7a8fbec5778f536d7c28018f14721d891514
Jul 09 04:32:17.181896 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:17.181764    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q94xd"
Jul 09 04:32:17.186644 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:17.186612    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q94xd"
Jul 09 04:32:17.746527 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:17.746449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8pz9" event={"ID":"dee135cd-d92f-4d0b-8214-ad8892e32c8c","Type":"ContainerStarted","Data":"c42ee4852aea31a67202ea33b8dd7a8fbec5778f536d7c28018f14721d891514"}
Jul 09 04:32:18.191170 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:18.191076    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 04:27:17 +0000 UTC" deadline="2028-03-01 18:02:48.104456883 +0000 UTC"
Jul 09 04:32:18.191170 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:18.191120    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14437h30m29.9133418s"
Jul 09 04:32:18.607512 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:18.607477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:18.607723 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:18.607530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:18.607723 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:18.607583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:18.607850 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.607744    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 04:32:18.607850 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.607765    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 04:32:18.607850 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.607778    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wbx9g for pod openshift-network-diagnostics/network-check-target-9xq6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:18.607850 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.607839    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g podName:00e26342-a654-48f1-8995-722ddde2c54c nodeName:}" failed. No retries permitted until 2026-07-09 04:32:22.607819132 +0000 UTC m=+9.768239646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbx9g" (UniqueName: "kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g") pod "network-check-target-9xq6x" (UID: "00e26342-a654-48f1-8995-722ddde2c54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:18.608062 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.607900    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:18.608062 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.607935    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:18.608062 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.607944    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs podName:f06f6d0f-a855-4390-82d8-0f739bc00705 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:22.607932987 +0000 UTC m=+9.768353490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs") pod "network-metrics-daemon-h9dcr" (UID: "f06f6d0f-a855-4390-82d8-0f739bc00705") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:18.608062 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.608013    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret podName:0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec nodeName:}" failed. No retries permitted until 2026-07-09 04:32:22.607994876 +0000 UTC m=+9.768415380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret") pod "global-pull-secret-syncer-qcr2r" (UID: "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:18.697849 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:18.697816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:18.698045 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.697958    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:18.698045 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:18.697979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:18.698159 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:18.698108    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:19.191480 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:19.191437    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 04:27:17 +0000 UTC" deadline="2028-04-09 22:25:28.871300806 +0000 UTC"
Jul 09 04:32:19.191480 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:19.191478    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15377h53m9.679828417s"
Jul 09 04:32:20.696270 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:20.696235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:20.696766 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:20.696409    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:20.696766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:20.696502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:20.696766 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:20.696614    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:22.638944 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:22.638907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:22.638969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:22.638998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret\") pod \"global-pull-secret-syncer-qcr2r\" (UID: \"0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec\") " pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639120    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639149    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639164    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wbx9g for pod openshift-network-diagnostics/network-check-target-9xq6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639172    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639124    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639223    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g podName:00e26342-a654-48f1-8995-722ddde2c54c nodeName:}" failed. No retries permitted until 2026-07-09 04:32:30.639205494 +0000 UTC m=+17.799626012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbx9g" (UniqueName: "kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g") pod "network-check-target-9xq6x" (UID: "00e26342-a654-48f1-8995-722ddde2c54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639247    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret podName:0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec nodeName:}" failed. No retries permitted until 2026-07-09 04:32:30.63923099 +0000 UTC m=+17.799651499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret") pod "global-pull-secret-syncer-qcr2r" (UID: "0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:22.639405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.639268    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs podName:f06f6d0f-a855-4390-82d8-0f739bc00705 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:30.639257296 +0000 UTC m=+17.799677805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs") pod "network-metrics-daemon-h9dcr" (UID: "f06f6d0f-a855-4390-82d8-0f739bc00705") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:22.696383 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:22.696347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:22.696577 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:22.696390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:22.696577 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.696489    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:22.696844 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:22.696815    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:24.696905 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.696833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:24.697375 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.696990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:24.697375 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:24.697086    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:24.697375 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:24.696985    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:24.727032 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.726997    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kube-system/global-pull-secret-syncer-qcr2r"]
Jul 09 04:32:24.727225 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.727124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:24.733015 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:24.732969    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-qcr2r\" is forbidden: User \"system:node:ip-10-0-134-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-134-202.ec2.internal' and this object" podUID="0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec" pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:24.733246 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.733223    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kube-system/global-pull-secret-syncer-qcr2r"]
Jul 09 04:32:24.753849 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.753797    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5wzfg"]
Jul 09 04:32:24.760218 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.760186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.760378 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:24.760279    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:24.762541 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:24.762500    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-qcr2r\" is forbidden: User \"system:node:ip-10-0-134-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-134-202.ec2.internal' and this object" podUID="0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec" pod="kube-system/global-pull-secret-syncer-qcr2r"
Jul 09 04:32:24.857114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.857075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-dbus\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.857314 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.857142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.857314 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.857193    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-kubelet-config\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.857314 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.857250    2563 reconciler_common.go:299] "Volume detached for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b7b5f5b-ca8f-4ad6-8885-1afef33f96ec-original-pull-secret\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:32:24.958145 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.958057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-dbus\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.958145 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.958124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.958374 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.958160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-kubelet-config\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.958374 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.958258    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-dbus\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.958374 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:24.958275    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-kubelet-config\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:24.958527 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:24.958376    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:24.958527 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:24.958433    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret podName:350a4e3a-b0df-4b14-9a1c-7337f7e933b0 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:25.45841542 +0000 UTC m=+12.618835944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret") pod "global-pull-secret-syncer-5wzfg" (UID: "350a4e3a-b0df-4b14-9a1c-7337f7e933b0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:25.461905 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:25.461867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:25.462100 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:25.461993    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:25.462100 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:25.462054    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret podName:350a4e3a-b0df-4b14-9a1c-7337f7e933b0 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:26.46203877 +0000 UTC m=+13.622459268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret") pod "global-pull-secret-syncer-5wzfg" (UID: "350a4e3a-b0df-4b14-9a1c-7337f7e933b0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:26.471826 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:26.471781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:26.472291 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:26.471890    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:26.472291 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:26.471957    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret podName:350a4e3a-b0df-4b14-9a1c-7337f7e933b0 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:28.47194102 +0000 UTC m=+15.632361538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret") pod "global-pull-secret-syncer-5wzfg" (UID: "350a4e3a-b0df-4b14-9a1c-7337f7e933b0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:26.695680 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:26.695629    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:26.695861 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:26.695682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:26.695861 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:26.695629    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:26.695861 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:26.695766    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:26.695861 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:26.695817    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:26.696047 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:26.695936    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:28.488947 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:28.488913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:28.489358 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:28.489096    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:28.489358 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:28.489177    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret podName:350a4e3a-b0df-4b14-9a1c-7337f7e933b0 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:32.48915722 +0000 UTC m=+19.649577728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret") pod "global-pull-secret-syncer-5wzfg" (UID: "350a4e3a-b0df-4b14-9a1c-7337f7e933b0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:28.696101 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:28.696063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:28.696101 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:28.696104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:28.696328 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:28.696192    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:28.696328 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:28.696073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:28.696328 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:28.696299    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:28.696478 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:28.696397    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:30.696152 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.695975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:30.696582 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.695975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:30.696582 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.696258    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:30.696582 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.695990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:30.696582 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.696338    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:30.696582 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.696403    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:30.703038 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.703018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:30.703149 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.703052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:30.703149 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.703132    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:30.703224 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.703160    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 04:32:30.703224 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.703176    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs podName:f06f6d0f-a855-4390-82d8-0f739bc00705 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:46.703161283 +0000 UTC m=+33.863581784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs") pod "network-metrics-daemon-h9dcr" (UID: "f06f6d0f-a855-4390-82d8-0f739bc00705") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 04:32:30.703224 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.703177    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 04:32:30.703224 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.703189    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wbx9g for pod openshift-network-diagnostics/network-check-target-9xq6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:30.703224 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:30.703224    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g podName:00e26342-a654-48f1-8995-722ddde2c54c nodeName:}" failed. No retries permitted until 2026-07-09 04:32:46.703213233 +0000 UTC m=+33.863633731 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbx9g" (UniqueName: "kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g") pod "network-check-target-9xq6x" (UID: "00e26342-a654-48f1-8995-722ddde2c54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 04:32:30.775248 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.775167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal" event={"ID":"4b12aea9bf8b99530f8679e8c6d1d16c","Type":"ContainerStarted","Data":"08e85527e729440657ebff343e56dfd1918743700b19ae0273ff35aed35288fd"}
Jul 09 04:32:30.777234 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.777199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"c8572927c7b345929e875691a62a0b6bbc4c37291491c0758cc5e8029ff2e399"}
Jul 09 04:32:30.777350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.777284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"37ea3307985a82f5eecb003e23aab18617fc09e469f8067abd78bc3e169f62fe"}
Jul 09 04:32:30.779853 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.779820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8pz9" event={"ID":"dee135cd-d92f-4d0b-8214-ad8892e32c8c","Type":"ContainerStarted","Data":"e28b302806f38a629927dda5723d40687bcb0e23b471a8c51a5ec14ac60d069b"}
Jul 09 04:32:30.780906 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.780873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qp2h6" event={"ID":"b3550305-0add-4db7-a0a5-8e307aa0b18e","Type":"ContainerStarted","Data":"0d8878fc88f04452841c4ac93ad1edbdf058547acad2fc41b2bbea723f60c2eb"}
Jul 09 04:32:30.790693 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.790603    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-202.ec2.internal" podStartSLOduration=14.790583267 podStartE2EDuration="14.790583267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:30.789777922 +0000 UTC m=+17.950198434" watchObservedRunningTime="2026-07-09 04:32:30.790583267 +0000 UTC m=+17.951003789"
Jul 09 04:32:30.808184 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:30.808131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n8pz9" podStartSLOduration=3.756300347 podStartE2EDuration="16.808113703s" totalImagesPullingTime="13.051813356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:30.807893867 +0000 UTC m=+17.968314388" watchObservedRunningTime="2026-07-09 04:32:30.808113703 +0000 UTC m=+17.968534225"
Jul 09 04:32:31.784806 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.784537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mkhc4" event={"ID":"2ef6d9a9-70fa-4853-a69c-bf8a3801895d","Type":"ContainerStarted","Data":"084b2f6d582d714aac6b9490307c696715b10ff94ece060e90b5df5432658aca"}
Jul 09 04:32:31.786064 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.786037    2563 generic.go:356] "Generic (PLEG): container finished" podID="3ee03c06c928493e4823bc059365a1f8" containerID="6ab4975aa6f64d47de7eb7cc9c3b958a501ca6fa28d1b3497f8dad01ecc8c346" exitCode=0
Jul 09 04:32:31.786167 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.786110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal" event={"ID":"3ee03c06c928493e4823bc059365a1f8","Type":"ContainerDied","Data":"6ab4975aa6f64d47de7eb7cc9c3b958a501ca6fa28d1b3497f8dad01ecc8c346"}
Jul 09 04:32:31.787450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.787421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mpvjz" event={"ID":"6f4a58c8-35e2-4fd6-b0ba-8849c606fe43","Type":"ContainerStarted","Data":"b29e90f18927d36682757744d503f684b42d8b2a534c96835353f403298d17d0"}
Jul 09 04:32:31.790193 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.790175    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:32:31.790501 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.790482    2563 generic.go:356] "Generic (PLEG): container finished" podID="cd6926db-2043-40d5-b6db-961112476d84" containerID="c8572927c7b345929e875691a62a0b6bbc4c37291491c0758cc5e8029ff2e399" exitCode=1
Jul 09 04:32:31.790568 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.790545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerDied","Data":"c8572927c7b345929e875691a62a0b6bbc4c37291491c0758cc5e8029ff2e399"}
Jul 09 04:32:31.790661 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.790629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"997ae3e792e671e0357c818cdf69fc584af7f60717f4ee5f392c9245429f900a"}
Jul 09 04:32:31.790758 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.790703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"dfb7e75800a3380209470e7c5580bdb2ef2aad159b89fd1b50e5221ab91a3cdc"}
Jul 09 04:32:31.790758 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.790752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"95ae4782729c4cd24e44ea7d97360c4804aef1d988909e076f7f771eed74daa1"}
Jul 09 04:32:31.790843 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.790783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"49d90b8770c3170f5b5d4c710fcee04f905788d328748759061cbb74e0b065a5"}
Jul 09 04:32:31.791955 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.791937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z2mdq" event={"ID":"450323ce-9fff-4a9a-8b3f-a5855a14ec9b","Type":"ContainerStarted","Data":"5077ebfe7fc38996abeb2d6c997e381130fdd59783187c9da17eaa9feb4953bf"}
Jul 09 04:32:31.793390 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.793370    2563 generic.go:356] "Generic (PLEG): container finished" podID="505231a1-3c45-41aa-8290-bd70ff742a2c" containerID="c9f22f177136017915ffb3275c25cb6c5cd66fb72fa3523127bbcb63f566b8b3" exitCode=0
Jul 09 04:32:31.793479 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.793432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerDied","Data":"c9f22f177136017915ffb3275c25cb6c5cd66fb72fa3523127bbcb63f566b8b3"}
Jul 09 04:32:31.794978 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.794922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb" event={"ID":"eebfdc3d-3f5e-476e-bfce-a74a767fd682","Type":"ContainerStarted","Data":"368e3fb98c930565572407cfe57ee78415d6bc29f55e7d4c2991597e3232d06d"}
Jul 09 04:32:31.799656 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.799606    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mkhc4" podStartSLOduration=2.570818596 podStartE2EDuration="16.799592604s" totalImagesPullingTime="14.228774008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:31.799082949 +0000 UTC m=+18.959503492" watchObservedRunningTime="2026-07-09 04:32:31.799592604 +0000 UTC m=+18.960013125"
Jul 09 04:32:31.859774 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.859722    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z2mdq" podStartSLOduration=2.7318555939999998 podStartE2EDuration="16.859704715s" totalImagesPullingTime="14.127849121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:31.845399283 +0000 UTC m=+19.005819803" watchObservedRunningTime="2026-07-09 04:32:31.859704715 +0000 UTC m=+19.020125237"
Jul 09 04:32:31.859916 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:31.859810    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mpvjz" podStartSLOduration=8.837709844 podStartE2EDuration="16.859802072s" totalImagesPullingTime="8.022092228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:31.859255022 +0000 UTC m=+19.019675544" watchObservedRunningTime="2026-07-09 04:32:31.859802072 +0000 UTC m=+19.020222592"
Jul 09 04:32:32.515938 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.515894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:32.516164 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:32.516028    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:32.516164 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:32.516091    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret podName:350a4e3a-b0df-4b14-9a1c-7337f7e933b0 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:40.516075524 +0000 UTC m=+27.676496025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret") pod "global-pull-secret-syncer-5wzfg" (UID: "350a4e3a-b0df-4b14-9a1c-7337f7e933b0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:32.695779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.695746    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:32.695779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.695763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:32.695972 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.695763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:32.695972 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:32.695880    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:32.696046 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:32.695990    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:32.696087 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:32.696048    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:32.798729 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.798629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nztfk" event={"ID":"8b6d99d6-c66b-4f69-b031-1057b114de77","Type":"ContainerStarted","Data":"f791e01d988a6d254a4b9e7c9203fdde1060f28ff514b37b744f04db73c56e67"}
Jul 09 04:32:32.800831 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.800792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal" event={"ID":"3ee03c06c928493e4823bc059365a1f8","Type":"ContainerStarted","Data":"b5ddf2caffbc2defe51bc2b476ad1c8008916e49ea44be4f0faec2314845a02a"}
Jul 09 04:32:32.813232 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.813179    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nztfk" podStartSLOduration=4.534479402 podStartE2EDuration="18.813161372s" totalImagesPullingTime="14.27868197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:32.812611319 +0000 UTC m=+19.973031835" watchObservedRunningTime="2026-07-09 04:32:32.813161372 +0000 UTC m=+19.973581895"
Jul 09 04:32:32.826783 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:32.826723    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-202.ec2.internal" podStartSLOduration=16.826701751999998 podStartE2EDuration="16.826701752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:32.825955395 +0000 UTC m=+19.986375917" watchObservedRunningTime="2026-07-09 04:32:32.826701752 +0000 UTC m=+19.987122273"
Jul 09 04:32:33.478257 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:33.478233    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 04:32:33.653678 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:33.653382    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T04:32:33.478254656Z","UUID":"a470de5b-bb76-492e-81a8-04b49345836c","Handler":null,"Name":"","Endpoint":""}
Jul 09 04:32:33.655340 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:33.655317    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 04:32:33.655471 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:33.655366    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 04:32:33.807752 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:33.807724    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:32:33.808234 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:33.808200    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"c0cfe7bb323d7b0efbf3b41ac6e31cb6525ca30295760dccbd0e7e387c47512c"}
Jul 09 04:32:33.810548 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:33.810521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb" event={"ID":"eebfdc3d-3f5e-476e-bfce-a74a767fd682","Type":"ContainerStarted","Data":"e2922e583fe04fb0321923526138a2c898725118caca7ca56d484aeba880ea2b"}
Jul 09 04:32:34.696408 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:34.696331    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:34.696597 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:34.696440    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:34.696597 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:34.696460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:34.696597 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:34.696485    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:34.696597 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:34.696576    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:34.696839 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:34.696680    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:34.815326 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:34.815293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb" event={"ID":"eebfdc3d-3f5e-476e-bfce-a74a767fd682","Type":"ContainerStarted","Data":"ef67e93b6fe757bafbd0bd1feae2abbcc333ad58583c4993fc88cc2c2ee20aca"}
Jul 09 04:32:34.833129 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:34.833082    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkjrb" podStartSLOduration=3.5274532130000003 podStartE2EDuration="20.833064252s" totalImagesPullingTime="17.305611039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:34.832095504 +0000 UTC m=+21.992516024" watchObservedRunningTime="2026-07-09 04:32:34.833064252 +0000 UTC m=+21.993484979"
Jul 09 04:32:35.092195 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:35.092163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:35.092975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:35.092955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:35.817831 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:35.817801    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:35.818276 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:35.818190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mpvjz"
Jul 09 04:32:36.696459 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.696231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:36.696762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.696231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:36.696762 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:36.696515    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:36.696762 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:36.696597    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:36.696762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.696297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:36.696762 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:36.696729    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:36.822733 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.822704    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:32:36.823265 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.823059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"f85c88ddcd9cc7ca99fe36db7e34104f182a88e0754288cc1c0149819bc37631"}
Jul 09 04:32:36.823318 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.823278    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:36.823484 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.823460    2563 scope.go:117] "RemoveContainer" containerID="c8572927c7b345929e875691a62a0b6bbc4c37291491c0758cc5e8029ff2e399"
Jul 09 04:32:36.825029 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.825002    2563 generic.go:356] "Generic (PLEG): container finished" podID="505231a1-3c45-41aa-8290-bd70ff742a2c" containerID="dc140a2d78bf314a68a04c2208addb1051415307a4c890d9ea646b6e9dacad5c" exitCode=0
Jul 09 04:32:36.825140 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.825077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerDied","Data":"dc140a2d78bf314a68a04c2208addb1051415307a4c890d9ea646b6e9dacad5c"}
Jul 09 04:32:36.839372 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:36.839351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:37.832470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.832436    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:32:37.833421 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.833383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" event={"ID":"cd6926db-2043-40d5-b6db-961112476d84","Type":"ContainerStarted","Data":"62e1ae608c6ba944f7770eef76e2193b63f979a69b345d03870826a9f5164cb8"}
Jul 09 04:32:37.833547 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.833485    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 04:32:37.833798 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.833767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:37.835865 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.835834    2563 generic.go:356] "Generic (PLEG): container finished" podID="505231a1-3c45-41aa-8290-bd70ff742a2c" containerID="7157906258bc347c71d96d096663c3c951c6775c0629d814887a7f5ee71d736b" exitCode=0
Jul 09 04:32:37.835988 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.835926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerDied","Data":"7157906258bc347c71d96d096663c3c951c6775c0629d814887a7f5ee71d736b"}
Jul 09 04:32:37.853724 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.853598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:37.861752 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:37.861698    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds" podStartSLOduration=8.079268015 podStartE2EDuration="22.861682081s" totalImagesPullingTime="14.782414066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:37.860445485 +0000 UTC m=+25.020866008" watchObservedRunningTime="2026-07-09 04:32:37.861682081 +0000 UTC m=+25.022102600"
Jul 09 04:32:38.320379 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:38.320120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5wzfg"]
Jul 09 04:32:38.320552 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:38.320497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:38.320657 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:38.320621    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:38.320890 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:38.320867    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xq6x"]
Jul 09 04:32:38.320987 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:38.320975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:38.321090 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:38.321049    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:38.322420 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:38.322394    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9dcr"]
Jul 09 04:32:38.322542 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:38.322510    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:38.322682 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:38.322614    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:38.838329 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:38.838301    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 04:32:39.129397 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:39.129315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:32:39.695723 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:39.695683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:39.695723 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:39.695721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:39.695947 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:39.695721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:39.695947 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:39.695807    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:39.695947 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:39.695899    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:39.696096 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:39.695957    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:40.579980 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:40.579944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:40.580444 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:40.580112    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:40.580444 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:40.580197    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret podName:350a4e3a-b0df-4b14-9a1c-7337f7e933b0 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:56.580172837 +0000 UTC m=+43.740593336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret") pod "global-pull-secret-syncer-5wzfg" (UID: "350a4e3a-b0df-4b14-9a1c-7337f7e933b0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 04:32:41.695793 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:41.695758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:41.695793 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:41.695782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:41.696185 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:41.695869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:41.696185 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:41.695878    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzfg" podUID="350a4e3a-b0df-4b14-9a1c-7337f7e933b0"
Jul 09 04:32:41.696185 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:41.695934    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9dcr" podUID="f06f6d0f-a855-4390-82d8-0f739bc00705"
Jul 09 04:32:41.696185 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:41.696024    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq6x" podUID="00e26342-a654-48f1-8995-722ddde2c54c"
Jul 09 04:32:42.849671 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:42.849467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerStarted","Data":"ffc8d6e16386e9b83a033f7ccb6b4e684a74212781771bd49d1acf1bffe06887"}
Jul 09 04:32:42.850907 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:42.850876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qp2h6" event={"ID":"b3550305-0add-4db7-a0a5-8e307aa0b18e","Type":"ContainerStarted","Data":"be5b759f0d81d9b59039c70e041ad2d00a2d4a5bb490e61c19ed12f27bde24ff"}
Jul 09 04:32:42.866423 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:42.866372    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qp2h6" podStartSLOduration=15.976955508 podStartE2EDuration="27.866357152s" totalImagesPullingTime="11.889401644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:42.865900868 +0000 UTC m=+30.026321379" watchObservedRunningTime="2026-07-09 04:32:42.866357152 +0000 UTC m=+30.026777672"
Jul 09 04:32:43.621408 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.621384    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-202.ec2.internal" event="NodeReady"
Jul 09 04:32:43.621586 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.621496    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 04:32:43.661345 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.661312    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c78hh"]
Jul 09 04:32:43.680631 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.680586    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84fgp"]
Jul 09 04:32:43.680927 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.680718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.683292 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.683269    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 04:32:43.683404 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.683273    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 04:32:43.683549 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.683536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-58ffk\""
Jul 09 04:32:43.701251 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.701222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84fgp"]
Jul 09 04:32:43.701251 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.701252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c78hh"]
Jul 09 04:32:43.701446 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.701301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:43.701446 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.701318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:43.701446 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.701398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:43.701446 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.701301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:43.704884 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.704861    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 04:32:43.705025 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.704860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mcbs\""
Jul 09 04:32:43.705025 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.704910    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 04:32:43.705025 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.704861    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 04:32:43.705025 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.704978    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9rkp9\""
Jul 09 04:32:43.705233 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.705037    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 04:32:43.705299 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.705239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 04:32:43.705846 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.705830    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 04:32:43.705846 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.705841    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 04:32:43.705949 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.705933    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bx88j\""
Jul 09 04:32:43.801860 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.801773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.801860 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.801812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8aa47b7-0d13-47da-b40d-5cde02a8d396-config-volume\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.801860 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.801835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9pd\" (UniqueName: \"kubernetes.io/projected/d8aa47b7-0d13-47da-b40d-5cde02a8d396-kube-api-access-rl9pd\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.802067 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.802015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rqs5\" (UniqueName: \"kubernetes.io/projected/4f17a5d0-890c-4198-a7d9-5db7cf99d3df-kube-api-access-8rqs5\") pod \"ingress-canary-84fgp\" (UID: \"4f17a5d0-890c-4198-a7d9-5db7cf99d3df\") " pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:43.802067 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.802039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f17a5d0-890c-4198-a7d9-5db7cf99d3df-cert\") pod \"ingress-canary-84fgp\" (UID: \"4f17a5d0-890c-4198-a7d9-5db7cf99d3df\") " pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:43.802067 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.802062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa47b7-0d13-47da-b40d-5cde02a8d396-tmp-dir\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.855767 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.855733    2563 generic.go:356] "Generic (PLEG): container finished" podID="505231a1-3c45-41aa-8290-bd70ff742a2c" containerID="ffc8d6e16386e9b83a033f7ccb6b4e684a74212781771bd49d1acf1bffe06887" exitCode=0
Jul 09 04:32:43.856226 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.855808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerDied","Data":"ffc8d6e16386e9b83a033f7ccb6b4e684a74212781771bd49d1acf1bffe06887"}
Jul 09 04:32:43.902660 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.902605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.902855 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.902672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8aa47b7-0d13-47da-b40d-5cde02a8d396-config-volume\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.902855 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.902703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9pd\" (UniqueName: \"kubernetes.io/projected/d8aa47b7-0d13-47da-b40d-5cde02a8d396-kube-api-access-rl9pd\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.902855 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.902736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rqs5\" (UniqueName: \"kubernetes.io/projected/4f17a5d0-890c-4198-a7d9-5db7cf99d3df-kube-api-access-8rqs5\") pod \"ingress-canary-84fgp\" (UID: \"4f17a5d0-890c-4198-a7d9-5db7cf99d3df\") " pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:43.902855 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.902751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f17a5d0-890c-4198-a7d9-5db7cf99d3df-cert\") pod \"ingress-canary-84fgp\" (UID: \"4f17a5d0-890c-4198-a7d9-5db7cf99d3df\") " pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:43.902855 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.902775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa47b7-0d13-47da-b40d-5cde02a8d396-tmp-dir\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.902855 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:43.902843    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 04:32:43.903144 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:43.902910    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls podName:d8aa47b7-0d13-47da-b40d-5cde02a8d396 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:44.402889049 +0000 UTC m=+31.563309561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls") pod "dns-default-c78hh" (UID: "d8aa47b7-0d13-47da-b40d-5cde02a8d396") : secret "dns-default-metrics-tls" not found
Jul 09 04:32:43.903144 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.903106    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa47b7-0d13-47da-b40d-5cde02a8d396-tmp-dir\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.903289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.903269    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8aa47b7-0d13-47da-b40d-5cde02a8d396-config-volume\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:43.907091 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.907067    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f17a5d0-890c-4198-a7d9-5db7cf99d3df-cert\") pod \"ingress-canary-84fgp\" (UID: \"4f17a5d0-890c-4198-a7d9-5db7cf99d3df\") " pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:43.913402 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.913378    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rqs5\" (UniqueName: \"kubernetes.io/projected/4f17a5d0-890c-4198-a7d9-5db7cf99d3df-kube-api-access-8rqs5\") pod \"ingress-canary-84fgp\" (UID: \"4f17a5d0-890c-4198-a7d9-5db7cf99d3df\") " pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:43.913513 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:43.913476    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9pd\" (UniqueName: \"kubernetes.io/projected/d8aa47b7-0d13-47da-b40d-5cde02a8d396-kube-api-access-rl9pd\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:44.016895 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:44.016858    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84fgp"
Jul 09 04:32:44.209830 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:44.209801    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84fgp"]
Jul 09 04:32:44.213972 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:44.213945    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f17a5d0_890c_4198_a7d9_5db7cf99d3df.slice/crio-f6fa2fcb3ef9c1c4bec1ad1bf19d8551e6b4e62ba7199d45d31bd22576244519 WatchSource:0}: Error finding container f6fa2fcb3ef9c1c4bec1ad1bf19d8551e6b4e62ba7199d45d31bd22576244519: Status 404 returned error can't find the container with id f6fa2fcb3ef9c1c4bec1ad1bf19d8551e6b4e62ba7199d45d31bd22576244519
Jul 09 04:32:44.408151 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:44.408053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:44.408322 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:44.408257    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 04:32:44.408382 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:44.408342    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls podName:d8aa47b7-0d13-47da-b40d-5cde02a8d396 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:45.40832047 +0000 UTC m=+32.568740967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls") pod "dns-default-c78hh" (UID: "d8aa47b7-0d13-47da-b40d-5cde02a8d396") : secret "dns-default-metrics-tls" not found
Jul 09 04:32:44.859333 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:44.859141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84fgp" event={"ID":"4f17a5d0-890c-4198-a7d9-5db7cf99d3df","Type":"ContainerStarted","Data":"f6fa2fcb3ef9c1c4bec1ad1bf19d8551e6b4e62ba7199d45d31bd22576244519"}
Jul 09 04:32:45.415034 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:45.414999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:45.415199 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:45.415176    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 04:32:45.415276 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:45.415259    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls podName:d8aa47b7-0d13-47da-b40d-5cde02a8d396 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:47.415236368 +0000 UTC m=+34.575656869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls") pod "dns-default-c78hh" (UID: "d8aa47b7-0d13-47da-b40d-5cde02a8d396") : secret "dns-default-metrics-tls" not found
Jul 09 04:32:46.584932 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.584899    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qmfpd"]
Jul 09 04:32:46.606012 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.605978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.609498 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.609471    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 04:32:46.609744 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.609708    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c4pmv\""
Jul 09 04:32:46.610395 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.610376    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 04:32:46.616212 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.616175    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 04:32:46.616380 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.616358    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 04:32:46.618856 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.618808    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qmfpd"]
Jul 09 04:32:46.711871 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.711837    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"]
Jul 09 04:32:46.725798 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.725763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.725975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.725831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:46.725975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.725875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a97b4d51-5ceb-43b2-b055-628ed26a925e-data-volume\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.725975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.725909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:32:46.725975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.725941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4qfp\" (UniqueName: \"kubernetes.io/projected/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-api-access-f4qfp\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.725975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.725973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a97b4d51-5ceb-43b2-b055-628ed26a925e-crio-socket\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.726236 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.726031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.726236 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:46.726092    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 04:32:46.726236 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:46.726146    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs podName:f06f6d0f-a855-4390-82d8-0f739bc00705 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:18.726128792 +0000 UTC m=+65.886549290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs") pod "network-metrics-daemon-h9dcr" (UID: "f06f6d0f-a855-4390-82d8-0f739bc00705") : secret "metrics-daemon-secret" not found
Jul 09 04:32:46.730669 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.730622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbx9g\" (UniqueName: \"kubernetes.io/projected/00e26342-a654-48f1-8995-722ddde2c54c-kube-api-access-wbx9g\") pod \"network-check-target-9xq6x\" (UID: \"00e26342-a654-48f1-8995-722ddde2c54c\") " pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:46.735375 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.735302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"]
Jul 09 04:32:46.735569 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.735435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"
Jul 09 04:32:46.738797 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.738763    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 04:32:46.739033 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.739001    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 04:32:46.739585 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.739422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kctl9\""
Jul 09 04:32:46.826484 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4qfp\" (UniqueName: \"kubernetes.io/projected/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-api-access-f4qfp\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.826484 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a97b4d51-5ceb-43b2-b055-628ed26a925e-crio-socket\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl4f8\" (UniqueName: \"kubernetes.io/projected/ebbbca45-6509-4463-a8a9-aa8425bb51f0-kube-api-access-sl4f8\") pod \"migrator-d57d58cc9-kb7j2\" (UID: \"ebbbca45-6509-4463-a8a9-aa8425bb51f0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:46.826667    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826677    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a97b4d51-5ceb-43b2-b055-628ed26a925e-crio-socket\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:46.826704    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a97b4d51-5ceb-43b2-b055-628ed26a925e-data-volume\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.826751 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:46.826742    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:47.326719429 +0000 UTC m=+34.487139945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : configmap "kube-rbac-proxy" not found
Jul 09 04:32:46.827132 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:46.826764    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:47.326754485 +0000 UTC m=+34.487174988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:46.827132 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.826999    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a97b4d51-5ceb-43b2-b055-628ed26a925e-data-volume\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.834891 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.834859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4qfp\" (UniqueName: \"kubernetes.io/projected/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-api-access-f4qfp\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:46.927659 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.927562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl4f8\" (UniqueName: \"kubernetes.io/projected/ebbbca45-6509-4463-a8a9-aa8425bb51f0-kube-api-access-sl4f8\") pod \"migrator-d57d58cc9-kb7j2\" (UID: \"ebbbca45-6509-4463-a8a9-aa8425bb51f0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"
Jul 09 04:32:46.936209 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:46.936180    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl4f8\" (UniqueName: \"kubernetes.io/projected/ebbbca45-6509-4463-a8a9-aa8425bb51f0-kube-api-access-sl4f8\") pod \"migrator-d57d58cc9-kb7j2\" (UID: \"ebbbca45-6509-4463-a8a9-aa8425bb51f0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"
Jul 09 04:32:47.026627 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.026590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:47.047755 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.047723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"
Jul 09 04:32:47.240874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.240667    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2"]
Jul 09 04:32:47.247745 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.247521    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xq6x"]
Jul 09 04:32:47.251490 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:47.251444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e26342_a654_48f1_8995_722ddde2c54c.slice/crio-8d02f22fdea733c20c5c4fe77dbff7f20452d4ea0d6898a82326e274d6a93e2c WatchSource:0}: Error finding container 8d02f22fdea733c20c5c4fe77dbff7f20452d4ea0d6898a82326e274d6a93e2c: Status 404 returned error can't find the container with id 8d02f22fdea733c20c5c4fe77dbff7f20452d4ea0d6898a82326e274d6a93e2c
Jul 09 04:32:47.331611 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.331567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:47.331611 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.331618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:47.331858 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:47.331707    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 04:32:47.331858 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:47.331764    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:47.331858 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:47.331777    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:48.331756599 +0000 UTC m=+35.492177097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : configmap "kube-rbac-proxy" not found
Jul 09 04:32:47.331858 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:47.331813    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:48.331800206 +0000 UTC m=+35.492220704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:47.432986 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.432895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:47.433145 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:47.433068    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 04:32:47.433205 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:47.433148    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls podName:d8aa47b7-0d13-47da-b40d-5cde02a8d396 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:51.43312714 +0000 UTC m=+38.593547645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls") pod "dns-default-c78hh" (UID: "d8aa47b7-0d13-47da-b40d-5cde02a8d396") : secret "dns-default-metrics-tls" not found
Jul 09 04:32:47.869137 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.869062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xq6x" event={"ID":"00e26342-a654-48f1-8995-722ddde2c54c","Type":"ContainerStarted","Data":"8d02f22fdea733c20c5c4fe77dbff7f20452d4ea0d6898a82326e274d6a93e2c"}
Jul 09 04:32:47.871040 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.870995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84fgp" event={"ID":"4f17a5d0-890c-4198-a7d9-5db7cf99d3df","Type":"ContainerStarted","Data":"26179a874744f9a7875e7e28ff59f0f2f07b5988eb0d2bde54106558f130ec11"}
Jul 09 04:32:47.873067 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.873039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2" event={"ID":"ebbbca45-6509-4463-a8a9-aa8425bb51f0","Type":"ContainerStarted","Data":"055e438bd09bc534400a0b36641e7df8cc2265296b674ee1761d2e36d442cd85"}
Jul 09 04:32:47.887600 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:47.887334    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84fgp" podStartSLOduration=2.004612682 podStartE2EDuration="4.887312203s" totalImagesPullingTime="2.882699521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:47.885989546 +0000 UTC m=+35.046410064" watchObservedRunningTime="2026-07-09 04:32:47.887312203 +0000 UTC m=+35.047732729"
Jul 09 04:32:48.341145 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.341109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:48.341350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.341178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:48.341350 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:48.341220    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 04:32:48.341350 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:48.341288    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.341268485 +0000 UTC m=+37.501689000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : configmap "kube-rbac-proxy" not found
Jul 09 04:32:48.341350 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:48.341311    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:48.341350 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:48.341345    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.341334657 +0000 UTC m=+37.501755157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:48.537894 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.537835    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mkhc4_2ef6d9a9-70fa-4853-a69c-bf8a3801895d/dns-node-resolver/0.log"
Jul 09 04:32:48.620868 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.620786    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-8sz4k"]
Jul 09 04:32:48.624949 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.624917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.627358 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.627327    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 04:32:48.627505 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.627484    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 04:32:48.628315 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.628291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 04:32:48.628418 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.628396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-255xl\""
Jul 09 04:32:48.628689 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.628558    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 04:32:48.632368 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.632310    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-8sz4k"]
Jul 09 04:32:48.745277 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.744819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkwjg\" (UniqueName: \"kubernetes.io/projected/e68a1abc-987f-49ea-a05d-088373be5c99-kube-api-access-bkwjg\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.745780 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.745564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e68a1abc-987f-49ea-a05d-088373be5c99-signing-cabundle\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.745780 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.745693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e68a1abc-987f-49ea-a05d-088373be5c99-signing-key\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.846704 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.846301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e68a1abc-987f-49ea-a05d-088373be5c99-signing-key\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.846704 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.846385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkwjg\" (UniqueName: \"kubernetes.io/projected/e68a1abc-987f-49ea-a05d-088373be5c99-kube-api-access-bkwjg\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.846704 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.846469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e68a1abc-987f-49ea-a05d-088373be5c99-signing-cabundle\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.847741 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.847691    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e68a1abc-987f-49ea-a05d-088373be5c99-signing-cabundle\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.850921 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.850864    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e68a1abc-987f-49ea-a05d-088373be5c99-signing-key\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.855981 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.855948    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkwjg\" (UniqueName: \"kubernetes.io/projected/e68a1abc-987f-49ea-a05d-088373be5c99-kube-api-access-bkwjg\") pod \"service-ca-758f599c5-8sz4k\" (UID: \"e68a1abc-987f-49ea-a05d-088373be5c99\") " pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:48.939484 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:48.939457    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-8sz4k"
Jul 09 04:32:49.105183 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:49.105147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-8sz4k"]
Jul 09 04:32:49.109675 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:49.109623    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68a1abc_987f_49ea_a05d_088373be5c99.slice/crio-6e37964b9292a56400b4ad4e451bf05d94b4b76c3c392466efae1f997857dc0f WatchSource:0}: Error finding container 6e37964b9292a56400b4ad4e451bf05d94b4b76c3c392466efae1f997857dc0f: Status 404 returned error can't find the container with id 6e37964b9292a56400b4ad4e451bf05d94b4b76c3c392466efae1f997857dc0f
Jul 09 04:32:49.739093 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:49.739059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z2mdq_450323ce-9fff-4a9a-8b3f-a5855a14ec9b/node-ca/0.log"
Jul 09 04:32:49.883227 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:49.883188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2" event={"ID":"ebbbca45-6509-4463-a8a9-aa8425bb51f0","Type":"ContainerStarted","Data":"02229ac43a6f10ce7f61a3516e4585a70e9948cf838e54ea1f7063df05c5f408"}
Jul 09 04:32:49.883423 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:49.883259    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2" event={"ID":"ebbbca45-6509-4463-a8a9-aa8425bb51f0","Type":"ContainerStarted","Data":"0d4901437c4cefb7acad26698eddb9d2fd89556bb970197013525be0e3265a4f"}
Jul 09 04:32:49.884504 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:49.884471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-8sz4k" event={"ID":"e68a1abc-987f-49ea-a05d-088373be5c99","Type":"ContainerStarted","Data":"6e37964b9292a56400b4ad4e451bf05d94b4b76c3c392466efae1f997857dc0f"}
Jul 09 04:32:49.898430 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:49.898374    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kb7j2" podStartSLOduration=2.3356538159999998 podStartE2EDuration="3.898355149s" totalImagesPullingTime="1.562701333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:49.898354557 +0000 UTC m=+37.058775078" watchObservedRunningTime="2026-07-09 04:32:49.898355149 +0000 UTC m=+37.058775670"
Jul 09 04:32:50.138976 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:50.138886    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84fgp_4f17a5d0-890c-4198-a7d9-5db7cf99d3df/serve-healthcheck-canary/0.log"
Jul 09 04:32:50.359277 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:50.359244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:50.359470 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:50.359305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:50.359470 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:50.359392    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 04:32:50.359470 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:50.359451    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:50.359470 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:50.359471    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:54.35945038 +0000 UTC m=+41.519870891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : configmap "kube-rbac-proxy" not found
Jul 09 04:32:50.359720 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:50.359501    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:32:54.35948757 +0000 UTC m=+41.519908070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:51.468722 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:51.468683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:51.469138 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:51.468849    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 04:32:51.469138 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:51.468916    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls podName:d8aa47b7-0d13-47da-b40d-5cde02a8d396 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:59.468900063 +0000 UTC m=+46.629320571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls") pod "dns-default-c78hh" (UID: "d8aa47b7-0d13-47da-b40d-5cde02a8d396") : secret "dns-default-metrics-tls" not found
Jul 09 04:32:52.894347 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:52.894312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xq6x" event={"ID":"00e26342-a654-48f1-8995-722ddde2c54c","Type":"ContainerStarted","Data":"b1e1ca63f4ebbc9f618e9ce8e4fb56005fbf9834c581280a0d3830c8ea4547c7"}
Jul 09 04:32:52.894805 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:52.894433    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:32:52.897198 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:52.897157    2563 generic.go:356] "Generic (PLEG): container finished" podID="505231a1-3c45-41aa-8290-bd70ff742a2c" containerID="7c8e483ec56337011ac877de1e32dedc35eeb581a1f130a5b9e7146f8ccdf4d8" exitCode=0
Jul 09 04:32:52.897336 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:52.897220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerDied","Data":"7c8e483ec56337011ac877de1e32dedc35eeb581a1f130a5b9e7146f8ccdf4d8"}
Jul 09 04:32:52.910422 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:52.910377    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9xq6x" podStartSLOduration=33.946355214 podStartE2EDuration="38.910364298s" totalImagesPullingTime="4.964009084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:52.909709473 +0000 UTC m=+40.070129995" watchObservedRunningTime="2026-07-09 04:32:52.910364298 +0000 UTC m=+40.070784818"
Jul 09 04:32:53.902895 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:53.902859    2563 generic.go:356] "Generic (PLEG): container finished" podID="505231a1-3c45-41aa-8290-bd70ff742a2c" containerID="e80d3620e9440a767ac15b54750fc7d8e5e7a4c56a2524ae51f2d62988ca8e05" exitCode=0
Jul 09 04:32:53.903284 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:53.902947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerDied","Data":"e80d3620e9440a767ac15b54750fc7d8e5e7a4c56a2524ae51f2d62988ca8e05"}
Jul 09 04:32:54.393656 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:54.393612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:54.393899 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:54.393706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:32:54.393899 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:54.393741    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 04:32:54.393899 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:54.393812    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:33:02.393794884 +0000 UTC m=+49.554215383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : configmap "kube-rbac-proxy" not found
Jul 09 04:32:54.393899 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:54.393879    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:54.394200 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:32:54.393947    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:33:02.39392936 +0000 UTC m=+49.554349861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : secret "insights-runtime-extractor-tls" not found
Jul 09 04:32:54.907743 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:54.907701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-8sz4k" event={"ID":"e68a1abc-987f-49ea-a05d-088373be5c99","Type":"ContainerStarted","Data":"464d492ac438a7c500ca5cca6feb656645c76129e99c8dc97a9d22711b95727c"}
Jul 09 04:32:54.911159 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:54.911129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wcn82" event={"ID":"505231a1-3c45-41aa-8290-bd70ff742a2c","Type":"ContainerStarted","Data":"47965e62fedc969ba51844aae1eb9aa04bbc8c51d6f91276e4a34be918399545"}
Jul 09 04:32:54.922960 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:54.922910    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-8sz4k" podStartSLOduration=1.900522254 podStartE2EDuration="6.92289164s" totalImagesPullingTime="5.022369386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:54.922116867 +0000 UTC m=+42.082537387" watchObservedRunningTime="2026-07-09 04:32:54.92289164 +0000 UTC m=+42.083312159"
Jul 09 04:32:54.944320 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:54.944269    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wcn82" podStartSLOduration=7.191617655 podStartE2EDuration="39.944253639s" totalImagesPullingTime="32.752635984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:54.94280224 +0000 UTC m=+42.103222762" watchObservedRunningTime="2026-07-09 04:32:54.944253639 +0000 UTC m=+42.104674162"
Jul 09 04:32:56.610565 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:56.610515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:56.612843 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:56.612812    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/350a4e3a-b0df-4b14-9a1c-7337f7e933b0-original-pull-secret\") pod \"global-pull-secret-syncer-5wzfg\" (UID: \"350a4e3a-b0df-4b14-9a1c-7337f7e933b0\") " pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:56.912340 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:56.912248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzfg"
Jul 09 04:32:57.070569 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:57.070523    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5wzfg"]
Jul 09 04:32:57.074809 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:57.074767    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350a4e3a_b0df_4b14_9a1c_7337f7e933b0.slice/crio-434500b967d56c3843b5a2e355a748e5c9d60b15490bb585714fc9670f13e0ca WatchSource:0}: Error finding container 434500b967d56c3843b5a2e355a748e5c9d60b15490bb585714fc9670f13e0ca: Status 404 returned error can't find the container with id 434500b967d56c3843b5a2e355a748e5c9d60b15490bb585714fc9670f13e0ca
Jul 09 04:32:57.923047 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:57.923008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5wzfg" event={"ID":"350a4e3a-b0df-4b14-9a1c-7337f7e933b0","Type":"ContainerStarted","Data":"434500b967d56c3843b5a2e355a748e5c9d60b15490bb585714fc9670f13e0ca"}
Jul 09 04:32:59.530005 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:59.529962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:59.532327 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:59.532304    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8aa47b7-0d13-47da-b40d-5cde02a8d396-metrics-tls\") pod \"dns-default-c78hh\" (UID: \"d8aa47b7-0d13-47da-b40d-5cde02a8d396\") " pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:59.591136 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:59.591099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c78hh"
Jul 09 04:32:59.750847 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:59.750815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c78hh"]
Jul 09 04:32:59.754328 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:32:59.754294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8aa47b7_0d13_47da_b40d_5cde02a8d396.slice/crio-336e5c9b50444ba413f620ad230e1f5a3ed7a7d96995db16b1ccfff8f6d06b9f WatchSource:0}: Error finding container 336e5c9b50444ba413f620ad230e1f5a3ed7a7d96995db16b1ccfff8f6d06b9f: Status 404 returned error can't find the container with id 336e5c9b50444ba413f620ad230e1f5a3ed7a7d96995db16b1ccfff8f6d06b9f
Jul 09 04:32:59.932062 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:32:59.931963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c78hh" event={"ID":"d8aa47b7-0d13-47da-b40d-5cde02a8d396","Type":"ContainerStarted","Data":"336e5c9b50444ba413f620ad230e1f5a3ed7a7d96995db16b1ccfff8f6d06b9f"}
Jul 09 04:33:02.454949 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:02.454907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:33:02.455450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:02.454972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:33:02.455450 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:02.455174    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 04:33:02.455450 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:02.455262    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls podName:a97b4d51-5ceb-43b2-b055-628ed26a925e nodeName:}" failed. No retries permitted until 2026-07-09 04:33:18.455236886 +0000 UTC m=+65.615657406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qmfpd" (UID: "a97b4d51-5ceb-43b2-b055-628ed26a925e") : secret "insights-runtime-extractor-tls" not found
Jul 09 04:33:02.455707 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:02.455526    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97b4d51-5ceb-43b2-b055-628ed26a925e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:33:03.947737 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:03.947694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5wzfg" event={"ID":"350a4e3a-b0df-4b14-9a1c-7337f7e933b0","Type":"ContainerStarted","Data":"205e4ee2d6a19870344856dcc23466b0bedb2b2270a6cc9e244cae847ac40b25"}
Jul 09 04:33:03.949344 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:03.949320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c78hh" event={"ID":"d8aa47b7-0d13-47da-b40d-5cde02a8d396","Type":"ContainerStarted","Data":"50c08be191d4f6752b1ba8c8b37e912e13294c7ca3c30a36840bbcf02be3394a"}
Jul 09 04:33:03.949426 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:03.949367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c78hh" event={"ID":"d8aa47b7-0d13-47da-b40d-5cde02a8d396","Type":"ContainerStarted","Data":"4b77d6c57ce4cfd0f25abf6a0c93fda7be7e0c4dea005feafd6808b4e3b6eeb4"}
Jul 09 04:33:03.949426 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:03.949402    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c78hh"
Jul 09 04:33:03.961801 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:03.961744    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5wzfg" podStartSLOduration=33.67333873 podStartE2EDuration="39.961724471s" totalImagesPullingTime="6.288385741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:03.9612677 +0000 UTC m=+51.121688221" watchObservedRunningTime="2026-07-09 04:33:03.961724471 +0000 UTC m=+51.122144993"
Jul 09 04:33:03.976148 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:03.976094    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c78hh" podStartSLOduration=17.371950358 podStartE2EDuration="20.976075376s" totalImagesPullingTime="3.604125018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:03.975889305 +0000 UTC m=+51.136309836" watchObservedRunningTime="2026-07-09 04:33:03.976075376 +0000 UTC m=+51.136495897"
Jul 09 04:33:10.853702 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:10.853668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbmds"
Jul 09 04:33:11.279583 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.279550    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"]
Jul 09 04:33:11.282548 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.282523    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"]
Jul 09 04:33:11.282669 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.282561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.284881 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.284854    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 04:33:11.284978 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.284877    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 04:33:11.284978 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.284903    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 04:33:11.285817 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.285803    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 04:33:11.285817 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.285812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-z8jjw\""
Jul 09 04:33:11.286133 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.286118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.288082 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.288064    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 04:33:11.293743 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.293724    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"]
Jul 09 04:33:11.294599 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.294579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"]
Jul 09 04:33:11.319465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.319436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cf5495a4-69d8-4eda-94eb-42447b67f2da-klusterlet-config\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.319465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.319465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bc5r\" (UniqueName: \"kubernetes.io/projected/cf5495a4-69d8-4eda-94eb-42447b67f2da-kube-api-access-6bc5r\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.319659 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.319557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24a506c5-0727-48a7-80d3-bb8b81a94bad-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c497b5bb-vnj7v\" (UID: \"24a506c5-0727-48a7-80d3-bb8b81a94bad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.319659 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.319625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf5495a4-69d8-4eda-94eb-42447b67f2da-tmp\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.319737 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.319666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlmkj\" (UniqueName: \"kubernetes.io/projected/24a506c5-0727-48a7-80d3-bb8b81a94bad-kube-api-access-hlmkj\") pod \"managed-serviceaccount-addon-agent-6c497b5bb-vnj7v\" (UID: \"24a506c5-0727-48a7-80d3-bb8b81a94bad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.420690 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.420628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf5495a4-69d8-4eda-94eb-42447b67f2da-tmp\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.420874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.420697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlmkj\" (UniqueName: \"kubernetes.io/projected/24a506c5-0727-48a7-80d3-bb8b81a94bad-kube-api-access-hlmkj\") pod \"managed-serviceaccount-addon-agent-6c497b5bb-vnj7v\" (UID: \"24a506c5-0727-48a7-80d3-bb8b81a94bad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.420874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.420726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cf5495a4-69d8-4eda-94eb-42447b67f2da-klusterlet-config\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.420874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.420742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bc5r\" (UniqueName: \"kubernetes.io/projected/cf5495a4-69d8-4eda-94eb-42447b67f2da-kube-api-access-6bc5r\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.420874 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.420801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24a506c5-0727-48a7-80d3-bb8b81a94bad-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c497b5bb-vnj7v\" (UID: \"24a506c5-0727-48a7-80d3-bb8b81a94bad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.421112 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.421089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf5495a4-69d8-4eda-94eb-42447b67f2da-tmp\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.423234 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.423213    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cf5495a4-69d8-4eda-94eb-42447b67f2da-klusterlet-config\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.423342 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.423275    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24a506c5-0727-48a7-80d3-bb8b81a94bad-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c497b5bb-vnj7v\" (UID: \"24a506c5-0727-48a7-80d3-bb8b81a94bad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.437846 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.437813    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlmkj\" (UniqueName: \"kubernetes.io/projected/24a506c5-0727-48a7-80d3-bb8b81a94bad-kube-api-access-hlmkj\") pod \"managed-serviceaccount-addon-agent-6c497b5bb-vnj7v\" (UID: \"24a506c5-0727-48a7-80d3-bb8b81a94bad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.438013 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.437821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bc5r\" (UniqueName: \"kubernetes.io/projected/cf5495a4-69d8-4eda-94eb-42447b67f2da-kube-api-access-6bc5r\") pod \"klusterlet-addon-workmgr-677d58468d-cswm6\" (UID: \"cf5495a4-69d8-4eda-94eb-42447b67f2da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.603062 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.602974    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"
Jul 09 04:33:11.609205 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.609184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:11.741244 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.741213    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"]
Jul 09 04:33:11.744983 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:11.744953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5495a4_69d8_4eda_94eb_42447b67f2da.slice/crio-e350562447a7b65a047ae9a4e9dbef0e946f6da2b90ee8c53a7f3191c5a0fafe WatchSource:0}: Error finding container e350562447a7b65a047ae9a4e9dbef0e946f6da2b90ee8c53a7f3191c5a0fafe: Status 404 returned error can't find the container with id e350562447a7b65a047ae9a4e9dbef0e946f6da2b90ee8c53a7f3191c5a0fafe
Jul 09 04:33:11.753335 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.753311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v"]
Jul 09 04:33:11.756628 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:11.756601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24a506c5_0727_48a7_80d3_bb8b81a94bad.slice/crio-0f3db9a37b7a9323098ed09905561ffd769220ae186f47a8bfebaf205811b41d WatchSource:0}: Error finding container 0f3db9a37b7a9323098ed09905561ffd769220ae186f47a8bfebaf205811b41d: Status 404 returned error can't find the container with id 0f3db9a37b7a9323098ed09905561ffd769220ae186f47a8bfebaf205811b41d
Jul 09 04:33:11.978390 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.978354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6" event={"ID":"cf5495a4-69d8-4eda-94eb-42447b67f2da","Type":"ContainerStarted","Data":"e350562447a7b65a047ae9a4e9dbef0e946f6da2b90ee8c53a7f3191c5a0fafe"}
Jul 09 04:33:11.979541 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:11.979515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v" event={"ID":"24a506c5-0727-48a7-80d3-bb8b81a94bad","Type":"ContainerStarted","Data":"0f3db9a37b7a9323098ed09905561ffd769220ae186f47a8bfebaf205811b41d"}
Jul 09 04:33:12.957667 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:12.956485    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"]
Jul 09 04:33:12.960675 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:12.959956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:12.963329 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:12.962860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jqlkg\""
Jul 09 04:33:12.963329 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:12.963158    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 04:33:12.970689 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:12.970240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"]
Jul 09 04:33:13.038357 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.038319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-49x2l\" (UID: \"a300d608-2513-4476-b935-ad41da68dbb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:13.139377 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.139344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-49x2l\" (UID: \"a300d608-2513-4476-b935-ad41da68dbb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:13.143687 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.143357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 04:33:13.152531 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:13.152137    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 04:33:13.152531 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:13.152245    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates podName:a300d608-2513-4476-b935-ad41da68dbb6 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:13.652221577 +0000 UTC m=+60.812642080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-49x2l" (UID: "a300d608-2513-4476-b935-ad41da68dbb6") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 04:33:13.183106 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.182429    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-g8vwv"]
Jul 09 04:33:13.185953 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.185911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-g8vwv"
Jul 09 04:33:13.191684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.190713    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 04:33:13.191684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.191169    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 04:33:13.191684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.191493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6vgtz\""
Jul 09 04:33:13.197499 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.196395    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-g8vwv"]
Jul 09 04:33:13.240347 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.240138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw5wh\" (UniqueName: \"kubernetes.io/projected/b39a6618-144c-485e-b17e-37e81838370e-kube-api-access-fw5wh\") pod \"downloads-685bfb5f64-g8vwv\" (UID: \"b39a6618-144c-485e-b17e-37e81838370e\") " pod="openshift-console/downloads-685bfb5f64-g8vwv"
Jul 09 04:33:13.341419 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.341003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw5wh\" (UniqueName: \"kubernetes.io/projected/b39a6618-144c-485e-b17e-37e81838370e-kube-api-access-fw5wh\") pod \"downloads-685bfb5f64-g8vwv\" (UID: \"b39a6618-144c-485e-b17e-37e81838370e\") " pod="openshift-console/downloads-685bfb5f64-g8vwv"
Jul 09 04:33:13.350565 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.350504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw5wh\" (UniqueName: \"kubernetes.io/projected/b39a6618-144c-485e-b17e-37e81838370e-kube-api-access-fw5wh\") pod \"downloads-685bfb5f64-g8vwv\" (UID: \"b39a6618-144c-485e-b17e-37e81838370e\") " pod="openshift-console/downloads-685bfb5f64-g8vwv"
Jul 09 04:33:13.507061 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.506804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-g8vwv"
Jul 09 04:33:13.745024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.744987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-49x2l\" (UID: \"a300d608-2513-4476-b935-ad41da68dbb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:13.745207 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:13.745175    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 04:33:13.745272 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:13.745244    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates podName:a300d608-2513-4476-b935-ad41da68dbb6 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:14.745224364 +0000 UTC m=+61.905644862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-49x2l" (UID: "a300d608-2513-4476-b935-ad41da68dbb6") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 04:33:13.955333 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:13.955250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c78hh"
Jul 09 04:33:14.753155 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:14.753116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-49x2l\" (UID: \"a300d608-2513-4476-b935-ad41da68dbb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:14.756112 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:14.756076    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a300d608-2513-4476-b935-ad41da68dbb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-49x2l\" (UID: \"a300d608-2513-4476-b935-ad41da68dbb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:14.775663 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:14.775624    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jqlkg\""
Jul 09 04:33:14.784478 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:14.784455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:16.704987 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:16.704951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-g8vwv"]
Jul 09 04:33:16.709527 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:16.709495    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39a6618_144c_485e_b17e_37e81838370e.slice/crio-70130b6be1d4e8ed04ffc642d9cca8b6efd73a89aac1cadb21ac1b2d1a8187bb WatchSource:0}: Error finding container 70130b6be1d4e8ed04ffc642d9cca8b6efd73a89aac1cadb21ac1b2d1a8187bb: Status 404 returned error can't find the container with id 70130b6be1d4e8ed04ffc642d9cca8b6efd73a89aac1cadb21ac1b2d1a8187bb
Jul 09 04:33:16.734030 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:16.733996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"]
Jul 09 04:33:16.739423 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:16.739394    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda300d608_2513_4476_b935_ad41da68dbb6.slice/crio-b9d948246d7b198b8be740b7c00ebf261cdd0476c007f3a1d5937a25885da8a3 WatchSource:0}: Error finding container b9d948246d7b198b8be740b7c00ebf261cdd0476c007f3a1d5937a25885da8a3: Status 404 returned error can't find the container with id b9d948246d7b198b8be740b7c00ebf261cdd0476c007f3a1d5937a25885da8a3
Jul 09 04:33:16.999559 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:16.999477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-g8vwv" event={"ID":"b39a6618-144c-485e-b17e-37e81838370e","Type":"ContainerStarted","Data":"70130b6be1d4e8ed04ffc642d9cca8b6efd73a89aac1cadb21ac1b2d1a8187bb"}
Jul 09 04:33:17.001338 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:17.001302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6" event={"ID":"cf5495a4-69d8-4eda-94eb-42447b67f2da","Type":"ContainerStarted","Data":"46eeedc68b009be07274f92e0caad1682cd620859bc1fbc165fc621de1225f65"}
Jul 09 04:33:17.001544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:17.001525    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:17.002553 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:17.002518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l" event={"ID":"a300d608-2513-4476-b935-ad41da68dbb6","Type":"ContainerStarted","Data":"b9d948246d7b198b8be740b7c00ebf261cdd0476c007f3a1d5937a25885da8a3"}
Jul 09 04:33:17.003401 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:17.003370    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6"
Jul 09 04:33:17.004059 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:17.004037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v" event={"ID":"24a506c5-0727-48a7-80d3-bb8b81a94bad","Type":"ContainerStarted","Data":"535b11a9f669aac7a5041a93023331262540d800fca8cd437ea1297e60115ffa"}
Jul 09 04:33:17.018711 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:17.018634    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677d58468d-cswm6" podStartSLOduration=1.1780182 podStartE2EDuration="6.018617859s" totalImagesPullingTime="4.840599659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:17.01753319 +0000 UTC m=+64.177953711" watchObservedRunningTime="2026-07-09 04:33:17.018617859 +0000 UTC m=+64.179038375"
Jul 09 04:33:17.047061 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:17.047007    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c497b5bb-vnj7v" podStartSLOduration=1.238443001 podStartE2EDuration="6.046988833s" totalImagesPullingTime="4.808545832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:17.046212779 +0000 UTC m=+64.206633300" watchObservedRunningTime="2026-07-09 04:33:17.046988833 +0000 UTC m=+64.207409364"
Jul 09 04:33:18.482590 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.482549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:33:18.484990 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.484952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97b4d51-5ceb-43b2-b055-628ed26a925e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmfpd\" (UID: \"a97b4d51-5ceb-43b2-b055-628ed26a925e\") " pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:33:18.719511 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.719475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c4pmv\""
Jul 09 04:33:18.727344 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.727306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qmfpd"
Jul 09 04:33:18.784163 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.784135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:33:18.786975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.786933    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06f6d0f-a855-4390-82d8-0f739bc00705-metrics-certs\") pod \"network-metrics-daemon-h9dcr\" (UID: \"f06f6d0f-a855-4390-82d8-0f739bc00705\") " pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:33:18.824959 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.824932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bx88j\""
Jul 09 04:33:18.832895 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.832853    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9dcr"
Jul 09 04:33:18.906164 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:18.906130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qmfpd"]
Jul 09 04:33:18.909571 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:18.909540    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97b4d51_5ceb_43b2_b055_628ed26a925e.slice/crio-2ca84bf9bc7864304ba7143e7d477a9e9b53b409b2c8b3e62343ef72850a9d07 WatchSource:0}: Error finding container 2ca84bf9bc7864304ba7143e7d477a9e9b53b409b2c8b3e62343ef72850a9d07: Status 404 returned error can't find the container with id 2ca84bf9bc7864304ba7143e7d477a9e9b53b409b2c8b3e62343ef72850a9d07
Jul 09 04:33:19.003357 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:19.003284    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9dcr"]
Jul 09 04:33:19.007504 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:19.007476    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06f6d0f_a855_4390_82d8_0f739bc00705.slice/crio-577efe3d2f26dfa845bddbf1d01060c2ac740a756dc7edeeb65d01fa53e0bcf1 WatchSource:0}: Error finding container 577efe3d2f26dfa845bddbf1d01060c2ac740a756dc7edeeb65d01fa53e0bcf1: Status 404 returned error can't find the container with id 577efe3d2f26dfa845bddbf1d01060c2ac740a756dc7edeeb65d01fa53e0bcf1
Jul 09 04:33:19.013853 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:19.013820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l" event={"ID":"a300d608-2513-4476-b935-ad41da68dbb6","Type":"ContainerStarted","Data":"d522403207a9c9f2bb9b91eb8138e12ed60858b980826f1f7717cf5f199a9392"}
Jul 09 04:33:19.014098 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:19.014077    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:19.015353 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:19.015326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9dcr" event={"ID":"f06f6d0f-a855-4390-82d8-0f739bc00705","Type":"ContainerStarted","Data":"577efe3d2f26dfa845bddbf1d01060c2ac740a756dc7edeeb65d01fa53e0bcf1"}
Jul 09 04:33:19.016779 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:19.016747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmfpd" event={"ID":"a97b4d51-5ceb-43b2-b055-628ed26a925e","Type":"ContainerStarted","Data":"2ca84bf9bc7864304ba7143e7d477a9e9b53b409b2c8b3e62343ef72850a9d07"}
Jul 09 04:33:19.019988 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:19.019965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l"
Jul 09 04:33:19.028042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:19.027983    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-49x2l" podStartSLOduration=5.047771146 podStartE2EDuration="7.02796403s" totalImagesPullingTime="1.980192884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:19.027580569 +0000 UTC m=+66.188001089" watchObservedRunningTime="2026-07-09 04:33:19.02796403 +0000 UTC m=+66.188384552"
Jul 09 04:33:20.015582 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.015532    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"]
Jul 09 04:33:20.029241 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.029203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"]
Jul 09 04:33:20.029415 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.029323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.033463 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.032847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-87sfb\""
Jul 09 04:33:20.033463 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.033135    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 04:33:20.033463 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.033140    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 04:33:20.033463 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.033310    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 04:33:20.042717 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.034069    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 04:33:20.042717 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.034328    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 04:33:20.093978 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.093931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.094217 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.094016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.094217 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.094067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dtr\" (UniqueName: \"kubernetes.io/projected/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-kube-api-access-n8dtr\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.094217 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.094095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.196473 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.195086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.196473 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.195142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.196473 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.195192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.196473 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.195243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dtr\" (UniqueName: \"kubernetes.io/projected/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-kube-api-access-n8dtr\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.196871 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.196678    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.199544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.199102    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.199544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.199501    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.203413 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.203368    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dtr\" (UniqueName: \"kubernetes.io/projected/fc1d4111-6fa3-4f51-9de8-9f3b8430f54a-kube-api-access-n8dtr\") pod \"prometheus-operator-567f7b8b7c-9kdfb\" (UID: \"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.346674 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.346537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"
Jul 09 04:33:20.653124 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:20.653047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb"]
Jul 09 04:33:20.835605 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:20.835567    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1d4111_6fa3_4f51_9de8_9f3b8430f54a.slice/crio-f98208303f69878271246085de2d1f7ec4199a483e8747bd606ab8ee5b2ec643 WatchSource:0}: Error finding container f98208303f69878271246085de2d1f7ec4199a483e8747bd606ab8ee5b2ec643: Status 404 returned error can't find the container with id f98208303f69878271246085de2d1f7ec4199a483e8747bd606ab8ee5b2ec643
Jul 09 04:33:21.026398 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:21.026324    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb" event={"ID":"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a","Type":"ContainerStarted","Data":"f98208303f69878271246085de2d1f7ec4199a483e8747bd606ab8ee5b2ec643"}
Jul 09 04:33:21.028242 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:21.028208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9dcr" event={"ID":"f06f6d0f-a855-4390-82d8-0f739bc00705","Type":"ContainerStarted","Data":"27556da80107440d89d6046c805f5e702b6bf05ce456ebca261358cf6431d617"}
Jul 09 04:33:23.906673 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:23.906558    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9xq6x"
Jul 09 04:33:25.051377 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:25.051292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9dcr" event={"ID":"f06f6d0f-a855-4390-82d8-0f739bc00705","Type":"ContainerStarted","Data":"d9315297f40a80500fd4b5b62907920371329ebe6b30b74735ce9969511a6947"}
Jul 09 04:33:25.053025 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:25.052997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmfpd" event={"ID":"a97b4d51-5ceb-43b2-b055-628ed26a925e","Type":"ContainerStarted","Data":"13f13ef0b2ed3f9891de3b824beaa9dd3fa1faa88f5b15d47b21b2ceaf040c4b"}
Jul 09 04:33:25.067551 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:25.067504    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h9dcr" podStartSLOduration=68.214893177 podStartE2EDuration="1m10.067491294s" totalImagesPullingTime="1.852598117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:25.06713125 +0000 UTC m=+72.227551771" watchObservedRunningTime="2026-07-09 04:33:25.067491294 +0000 UTC m=+72.227911805"
Jul 09 04:33:26.061772 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:26.061735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb" event={"ID":"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a","Type":"ContainerStarted","Data":"e8f74e53589edb41c74b4f7b008c970d12ac9c6615a128b45fcaf5bceec98e1d"}
Jul 09 04:33:26.062200 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:26.061823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb" event={"ID":"fc1d4111-6fa3-4f51-9de8-9f3b8430f54a","Type":"ContainerStarted","Data":"615450e35d14cb6df542874379eef0180c0aacf76492d580686695b76cc79a89"}
Jul 09 04:33:26.063320 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:26.063301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmfpd" event={"ID":"a97b4d51-5ceb-43b2-b055-628ed26a925e","Type":"ContainerStarted","Data":"e1e29e37b7866dc90d58e71e71164fbd35b6e7b3a5a207b55b17e7607f10fe7d"}
Jul 09 04:33:26.078758 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:26.078710    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9kdfb" podStartSLOduration=2.788530916 podStartE2EDuration="7.078694796s" totalImagesPullingTime="4.29016388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:26.077205335 +0000 UTC m=+73.237625855" watchObservedRunningTime="2026-07-09 04:33:26.078694796 +0000 UTC m=+73.239115294"
Jul 09 04:33:28.387016 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.386915    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cng67"]
Jul 09 04:33:28.403357 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.403196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.406521 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.406201    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 04:33:28.406521 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.406280    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 04:33:28.406521 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.406327    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 04:33:28.406521 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.406280    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cxmjg\""
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-sys\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-textfile\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-wtmp\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e25147d0-b85f-47e7-8ded-6209e3f875e4-metrics-client-ca\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsdfl\" (UniqueName: \"kubernetes.io/projected/e25147d0-b85f-47e7-8ded-6209e3f875e4-kube-api-access-vsdfl\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-root\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.469004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.468893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-tls\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.569769 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-root\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.569891 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-tls\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.569891 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-sys\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.569891 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-textfile\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570053 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-wtmp\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570053 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e25147d0-b85f-47e7-8ded-6209e3f875e4-metrics-client-ca\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570053 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570053 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:28.569976    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 04:33:28.570053 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.569996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570053 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:28.570041    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-tls podName:e25147d0-b85f-47e7-8ded-6209e3f875e4 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:29.070019292 +0000 UTC m=+76.230439804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-tls") pod "node-exporter-cng67" (UID: "e25147d0-b85f-47e7-8ded-6209e3f875e4") : secret "node-exporter-tls" not found
Jul 09 04:33:28.570345 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.570081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsdfl\" (UniqueName: \"kubernetes.io/projected/e25147d0-b85f-47e7-8ded-6209e3f875e4-kube-api-access-vsdfl\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570345 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.570292    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-root\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570447 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.570346    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-sys\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570447 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.570430    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-wtmp\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570661 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.570608    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-textfile\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.570748 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.570635    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.571224 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.570919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e25147d0-b85f-47e7-8ded-6209e3f875e4-metrics-client-ca\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.573780 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.573756    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:28.583508 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:28.583485    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsdfl\" (UniqueName: \"kubernetes.io/projected/e25147d0-b85f-47e7-8ded-6209e3f875e4-kube-api-access-vsdfl\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:29.073587 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.073553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-tls\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:29.076007 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.075988    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e25147d0-b85f-47e7-8ded-6209e3f875e4-node-exporter-tls\") pod \"node-exporter-cng67\" (UID: \"e25147d0-b85f-47e7-8ded-6209e3f875e4\") " pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:29.080427 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.080394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmfpd" event={"ID":"a97b4d51-5ceb-43b2-b055-628ed26a925e","Type":"ContainerStarted","Data":"b7c8c3365e3c275d92ca22768b6b84ed80673472ef3643f089fac472e1ed7db0"}
Jul 09 04:33:29.100660 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.100594    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qmfpd" podStartSLOduration=33.65221224 podStartE2EDuration="43.100574928s" totalImagesPullingTime="9.448362688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:29.099542818 +0000 UTC m=+76.259963353" watchObservedRunningTime="2026-07-09 04:33:29.100574928 +0000 UTC m=+76.260995448"
Jul 09 04:33:29.319081 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.319047    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cng67"
Jul 09 04:33:29.331631 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:29.331601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25147d0_b85f_47e7_8ded_6209e3f875e4.slice/crio-3cef19fef167956609cc5cb627ddd1d5f83f09de53f12dc4c68d570d93fa82e7 WatchSource:0}: Error finding container 3cef19fef167956609cc5cb627ddd1d5f83f09de53f12dc4c68d570d93fa82e7: Status 404 returned error can't find the container with id 3cef19fef167956609cc5cb627ddd1d5f83f09de53f12dc4c68d570d93fa82e7
Jul 09 04:33:29.433755 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.433707    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:33:29.439621 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.439591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.442301 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.442202    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 04:33:29.442951 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.442587    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 04:33:29.442951 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.442590    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 04:33:29.442951 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.442706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 04:33:29.442951 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.442714    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vmp4l\""
Jul 09 04:33:29.442951 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.442881    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 04:33:29.442951 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.442893    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 04:33:29.444806 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.443045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 04:33:29.444806 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.443100    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 04:33:29.444806 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.443208    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 04:33:29.451263 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.450814    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:33:29.478015 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.477927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-web-config\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478235 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478314 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc65t\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-kube-api-access-hc65t\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478377 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-config-volume\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478433 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478433 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478533 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478533 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478533 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478690 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-config-out\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478690 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478788 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.478788 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.478727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.580100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.579691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.580100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.579745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.580100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.579775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-web-config\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.580100 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.579802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.580425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.580257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc65t\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-kube-api-access-hc65t\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.580425 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.580335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-config-volume\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.580710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.580936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.581156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.581198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:29.581415    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle podName:af2bc8ee-950a-433d-875b-88b92c1b1726 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:30.08139141 +0000 UTC m=+77.241811907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726") : configmap references non-existent config key: ca-bundle.crt
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.581473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.581504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-config-out\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.581551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:29.581799    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:29.581972    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls podName:af2bc8ee-950a-433d-875b-88b92c1b1726 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:30.081853741 +0000 UTC m=+77.242274239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726") : secret "alertmanager-main-tls" not found
Jul 09 04:33:29.582486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.582407    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.583773 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.583730    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.584015 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.583990    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-web-config\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.584798 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.584775    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.585663 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.585592    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.586208 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.586185    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.586898 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.586848    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-config-volume\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.587239 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.587029    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.587239 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.587117    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-config-out\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.587813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.587792    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:29.589596 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:29.589571    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc65t\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-kube-api-access-hc65t\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:30.086332 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:30.086292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cng67" event={"ID":"e25147d0-b85f-47e7-8ded-6209e3f875e4","Type":"ContainerStarted","Data":"3cef19fef167956609cc5cb627ddd1d5f83f09de53f12dc4c68d570d93fa82e7"}
Jul 09 04:33:30.086547 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:30.086462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:30.086547 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:30.086505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:30.087457 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:30.087425    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:30.089337 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:30.089313    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:30.355739 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:30.355662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:33:32.678231 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.676445    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"]
Jul 09 04:33:32.681549 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.681511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.684873 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.684845    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 04:33:32.684873 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.684868    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d40jskkuknd70\""
Jul 09 04:33:32.685096 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.684882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 04:33:32.685096 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.685011    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tm7bb\""
Jul 09 04:33:32.685096 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.685011    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 04:33:32.685348 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.685146    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 04:33:32.688598 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.688542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"]
Jul 09 04:33:32.812700 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.812661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df4fe430-24c6-482c-be9c-9d7c03d10622-audit-log\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.812903 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.812720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df4fe430-24c6-482c-be9c-9d7c03d10622-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.812903 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.812768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-secret-metrics-server-tls\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.812903 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.812839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9lkv\" (UniqueName: \"kubernetes.io/projected/df4fe430-24c6-482c-be9c-9d7c03d10622-kube-api-access-t9lkv\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.813069 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.812917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-secret-metrics-server-client-certs\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.813069 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.812958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-client-ca-bundle\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.813069 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.812993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df4fe430-24c6-482c-be9c-9d7c03d10622-metrics-server-audit-profiles\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914033 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.913967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-secret-metrics-server-client-certs\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.914040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-client-ca-bundle\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.914066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df4fe430-24c6-482c-be9c-9d7c03d10622-metrics-server-audit-profiles\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.914100    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df4fe430-24c6-482c-be9c-9d7c03d10622-audit-log\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.914129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df4fe430-24c6-482c-be9c-9d7c03d10622-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.914183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-secret-metrics-server-tls\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.914228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9lkv\" (UniqueName: \"kubernetes.io/projected/df4fe430-24c6-482c-be9c-9d7c03d10622-kube-api-access-t9lkv\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.914676 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.914622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df4fe430-24c6-482c-be9c-9d7c03d10622-audit-log\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.915085 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.915016    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df4fe430-24c6-482c-be9c-9d7c03d10622-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.915297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.915274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df4fe430-24c6-482c-be9c-9d7c03d10622-metrics-server-audit-profiles\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.916913 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.916885    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-client-ca-bundle\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.917128 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.917104    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-secret-metrics-server-client-certs\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.917179 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.917130    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df4fe430-24c6-482c-be9c-9d7c03d10622-secret-metrics-server-tls\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.921563 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.921541    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9lkv\" (UniqueName: \"kubernetes.io/projected/df4fe430-24c6-482c-be9c-9d7c03d10622-kube-api-access-t9lkv\") pod \"metrics-server-7d8d8bdb8b-kldp9\" (UID: \"df4fe430-24c6-482c-be9c-9d7c03d10622\") " pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:32.993630 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:32.993593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:33.157415 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.157380    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"]
Jul 09 04:33:33.160804 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.160779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:33.163104 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.163083    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 04:33:33.163234 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.163088    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-44zd5\""
Jul 09 04:33:33.167913 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.167833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"]
Jul 09 04:33:33.216916 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.216861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:33.216916 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.216915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdqn9\" (UniqueName: \"kubernetes.io/projected/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-kube-api-access-mdqn9\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:33.318381 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.318299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:33.318381 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.318344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqn9\" (UniqueName: \"kubernetes.io/projected/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-kube-api-access-mdqn9\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:33.318608 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:33.318471    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 09 04:33:33.318608 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:33.318551    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert podName:3678f0c2-1f4f-470c-8920-0fe33ccd5c18 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:33.818530409 +0000 UTC m=+80.978950908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-rw9bk" (UID: "3678f0c2-1f4f-470c-8920-0fe33ccd5c18") : secret "monitoring-plugin-cert" not found
Jul 09 04:33:33.327191 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.327155    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdqn9\" (UniqueName: \"kubernetes.io/projected/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-kube-api-access-mdqn9\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:33.824085 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:33.824025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:33.824571 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:33.824199    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 09 04:33:33.824571 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:33:33.824304    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert podName:3678f0c2-1f4f-470c-8920-0fe33ccd5c18 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:34.824280293 +0000 UTC m=+81.984700852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-rw9bk" (UID: "3678f0c2-1f4f-470c-8920-0fe33ccd5c18") : secret "monitoring-plugin-cert" not found
Jul 09 04:33:34.833956 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:34.833913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:34.836999 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:34.836961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3678f0c2-1f4f-470c-8920-0fe33ccd5c18-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rw9bk\" (UID: \"3678f0c2-1f4f-470c-8920-0fe33ccd5c18\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:34.976403 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:34.976345    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:38.483486 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:38.483453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"]
Jul 09 04:33:38.487145 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:38.487110    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3678f0c2_1f4f_470c_8920_0fe33ccd5c18.slice/crio-33a395d42613e8b38073d637eea49e458d0dda3f69ab1718e16f8fe206c62ace WatchSource:0}: Error finding container 33a395d42613e8b38073d637eea49e458d0dda3f69ab1718e16f8fe206c62ace: Status 404 returned error can't find the container with id 33a395d42613e8b38073d637eea49e458d0dda3f69ab1718e16f8fe206c62ace
Jul 09 04:33:38.510907 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:38.510879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:33:38.513473 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:38.513146    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2bc8ee_950a_433d_875b_88b92c1b1726.slice/crio-2fb94a95aeef4127a7f46209de26c14b52864031ab2a17dd6e9c05787a548629 WatchSource:0}: Error finding container 2fb94a95aeef4127a7f46209de26c14b52864031ab2a17dd6e9c05787a548629: Status 404 returned error can't find the container with id 2fb94a95aeef4127a7f46209de26c14b52864031ab2a17dd6e9c05787a548629
Jul 09 04:33:38.534077 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:38.534043    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"]
Jul 09 04:33:38.538379 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:33:38.538348    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4fe430_24c6_482c_be9c_9d7c03d10622.slice/crio-375de666cdcd28a5f646316d24e44edd4609b064104558dec3e0b3861c817d50 WatchSource:0}: Error finding container 375de666cdcd28a5f646316d24e44edd4609b064104558dec3e0b3861c817d50: Status 404 returned error can't find the container with id 375de666cdcd28a5f646316d24e44edd4609b064104558dec3e0b3861c817d50
Jul 09 04:33:39.124240 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.124136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9" event={"ID":"df4fe430-24c6-482c-be9c-9d7c03d10622","Type":"ContainerStarted","Data":"375de666cdcd28a5f646316d24e44edd4609b064104558dec3e0b3861c817d50"}
Jul 09 04:33:39.125917 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.125882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk" event={"ID":"3678f0c2-1f4f-470c-8920-0fe33ccd5c18","Type":"ContainerStarted","Data":"33a395d42613e8b38073d637eea49e458d0dda3f69ab1718e16f8fe206c62ace"}
Jul 09 04:33:39.127705 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.127600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerStarted","Data":"2fb94a95aeef4127a7f46209de26c14b52864031ab2a17dd6e9c05787a548629"}
Jul 09 04:33:39.129738 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.129713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-g8vwv" event={"ID":"b39a6618-144c-485e-b17e-37e81838370e","Type":"ContainerStarted","Data":"1933cdac0d71d39fc962d92891e4bd47c3d0a5a3ab393a62c9135081463849dc"}
Jul 09 04:33:39.130547 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.130328    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-g8vwv"
Jul 09 04:33:39.132440 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.132412    2563 generic.go:356] "Generic (PLEG): container finished" podID="e25147d0-b85f-47e7-8ded-6209e3f875e4" containerID="6fb38f1556dddbc9606a6a611b9230988791b4857dca2c0e7404665f38ddf367" exitCode=0
Jul 09 04:33:39.132562 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.132469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cng67" event={"ID":"e25147d0-b85f-47e7-8ded-6209e3f875e4","Type":"ContainerDied","Data":"6fb38f1556dddbc9606a6a611b9230988791b4857dca2c0e7404665f38ddf367"}
Jul 09 04:33:39.141571 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.141417    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-g8vwv"
Jul 09 04:33:39.168274 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:39.168213    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-g8vwv" podStartSLOduration=4.537772051 podStartE2EDuration="26.168191192s" totalImagesPullingTime="21.630419141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:39.149241106 +0000 UTC m=+86.309661631" watchObservedRunningTime="2026-07-09 04:33:39.168191192 +0000 UTC m=+86.328611715"
Jul 09 04:33:40.143206 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:40.143165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cng67" event={"ID":"e25147d0-b85f-47e7-8ded-6209e3f875e4","Type":"ContainerStarted","Data":"c0febf588f21158e346b2049b411f8ee075b45ac24625ddc90d883c65e034817"}
Jul 09 04:33:40.143710 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:40.143222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cng67" event={"ID":"e25147d0-b85f-47e7-8ded-6209e3f875e4","Type":"ContainerStarted","Data":"db76dc11a71e9fa7e6b93090853f92cbca7c92af8f9a91c611159efbb34ad391"}
Jul 09 04:33:40.164694 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:40.164586    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cng67" podStartSLOduration=3.085996754 podStartE2EDuration="12.16456817s" totalImagesPullingTime="8.996626338s" totalInitContainerRuntime="81.945078ms" isStatefulPod=true podCreationTimestamp="2026-07-09 04:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:40.162822257 +0000 UTC m=+87.323242780" watchObservedRunningTime="2026-07-09 04:33:40.16456817 +0000 UTC m=+87.324988689"
Jul 09 04:33:43.157697 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.157633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9" event={"ID":"df4fe430-24c6-482c-be9c-9d7c03d10622","Type":"ContainerStarted","Data":"baf5cbcd6fb37f8302b4ca65b1c0451af57de12b092891731700757d5a4a25f5"}
Jul 09 04:33:43.159497 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.159469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk" event={"ID":"3678f0c2-1f4f-470c-8920-0fe33ccd5c18","Type":"ContainerStarted","Data":"ef56519f792881cd124d327350831e9108ac77261c3f67c5d68ee4605c74ab7d"}
Jul 09 04:33:43.159724 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.159679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:43.161409 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.161377    2563 generic.go:356] "Generic (PLEG): container finished" podID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerID="c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3" exitCode=0
Jul 09 04:33:43.161506 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.161425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3"}
Jul 09 04:33:43.166396 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.166373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk"
Jul 09 04:33:43.175663 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.175603    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9" podStartSLOduration=7.635835198 podStartE2EDuration="11.175581811s" totalImagesPullingTime="3.539746613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:43.174447316 +0000 UTC m=+90.334867838" watchObservedRunningTime="2026-07-09 04:33:43.175581811 +0000 UTC m=+90.336002332"
Jul 09 04:33:43.190378 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:43.190316    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rw9bk" podStartSLOduration=6.603712904 podStartE2EDuration="10.190295014s" totalImagesPullingTime="3.58658211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:43.188271588 +0000 UTC m=+90.348692108" watchObservedRunningTime="2026-07-09 04:33:43.190295014 +0000 UTC m=+90.350715534"
Jul 09 04:33:47.182866 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:47.182821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerStarted","Data":"13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60"}
Jul 09 04:33:47.183411 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:47.182917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerStarted","Data":"cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4"}
Jul 09 04:33:47.183411 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:47.182959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerStarted","Data":"fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c"}
Jul 09 04:33:47.183411 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:47.183001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerStarted","Data":"f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889"}
Jul 09 04:33:47.183411 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:47.183040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerStarted","Data":"521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343"}
Jul 09 04:33:48.190818 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:48.190727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerStarted","Data":"574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc"}
Jul 09 04:33:48.217121 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:48.217063    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=11.461807874 podStartE2EDuration="19.217043039s" totalImagesPullingTime="7.729283376s" totalInitContainerRuntime="25.951789ms" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:48.215588405 +0000 UTC m=+95.376008925" watchObservedRunningTime="2026-07-09 04:33:48.217043039 +0000 UTC m=+95.377463551"
Jul 09 04:33:52.994332 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:52.994291    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:52.994817 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:52.994360    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:33:57.087928 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:33:57.087888    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84fgp_4f17a5d0-890c-4198-a7d9-5db7cf99d3df/serve-healthcheck-canary/0.log"
Jul 09 04:34:12.999472 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:12.999432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:34:13.003416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:13.003393    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d8d8bdb8b-kldp9"
Jul 09 04:34:48.659410 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:48.659379    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:34:48.659887 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:48.659679    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="alertmanager" containerID="cri-o://521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343" gracePeriod=120
Jul 09 04:34:48.659887 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:48.659745    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="prom-label-proxy" containerID="cri-o://574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc" gracePeriod=120
Jul 09 04:34:48.659887 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:48.659788    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-web" containerID="cri-o://fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c" gracePeriod=120
Jul 09 04:34:48.659887 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:48.659811    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="config-reloader" containerID="cri-o://f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889" gracePeriod=120
Jul 09 04:34:48.659887 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:48.659738    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-metric" containerID="cri-o://13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60" gracePeriod=120
Jul 09 04:34:48.660148 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:48.659906    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy" containerID="cri-o://cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4" gracePeriod=120
Jul 09 04:34:49.415158 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415126    2563 generic.go:356] "Generic (PLEG): container finished" podID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerID="574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc" exitCode=0
Jul 09 04:34:49.415158 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415148    2563 generic.go:356] "Generic (PLEG): container finished" podID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerID="13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60" exitCode=0
Jul 09 04:34:49.415158 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415155    2563 generic.go:356] "Generic (PLEG): container finished" podID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerID="cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4" exitCode=0
Jul 09 04:34:49.415158 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415161    2563 generic.go:356] "Generic (PLEG): container finished" podID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerID="f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889" exitCode=0
Jul 09 04:34:49.415158 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415167    2563 generic.go:356] "Generic (PLEG): container finished" podID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerID="521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343" exitCode=0
Jul 09 04:34:49.415441 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415194    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc"}
Jul 09 04:34:49.415441 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415259    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60"}
Jul 09 04:34:49.415441 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4"}
Jul 09 04:34:49.415441 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889"}
Jul 09 04:34:49.415441 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.415338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343"}
Jul 09 04:34:49.907757 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:49.907734    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.079450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079348    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-config-volume\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-main-db\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079450 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079826 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079826 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079525    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-web-config\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079826 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079553    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-metric\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079826 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079590    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-web\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079826 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079623    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-metrics-client-ca\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.079826 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.079789    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:34:50.080131 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080013    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:34:50.080131 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080045    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:34:50.080131 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080058    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-tls-assets\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.080131 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc65t\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-kube-api-access-hc65t\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.080340 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-config-out\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.080340 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080202    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-cluster-tls-config\") pod \"af2bc8ee-950a-433d-875b-88b92c1b1726\" (UID: \"af2bc8ee-950a-433d-875b-88b92c1b1726\") "
Jul 09 04:34:50.080524 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080447    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-metrics-client-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.080524 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080466    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-main-db\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.080524 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.080482    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af2bc8ee-950a-433d-875b-88b92c1b1726-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.082454 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.082405    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:34:50.082604 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.082497    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:34:50.082604 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.082544    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:34:50.082735 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.082633    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-config-volume" (OuterVolumeSpecName: "config-volume") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:34:50.083161 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.083129    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:34:50.083261 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.083176    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-kube-api-access-hc65t" (OuterVolumeSpecName: "kube-api-access-hc65t") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "kube-api-access-hc65t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:34:50.083480 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.083449    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-config-out" (OuterVolumeSpecName: "config-out") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:34:50.084002 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.083983    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:34:50.088345 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.088320    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:34:50.094596 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.094461    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-web-config" (OuterVolumeSpecName: "web-config") pod "af2bc8ee-950a-433d-875b-88b92c1b1726" (UID: "af2bc8ee-950a-433d-875b-88b92c1b1726"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:34:50.181745 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181699    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-cluster-tls-config\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181745 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181743    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-config-volume\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181745 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181756    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-main-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181993 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181766    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181993 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181776    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-web-config\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181993 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181785    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181993 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181793    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af2bc8ee-950a-433d-875b-88b92c1b1726-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181993 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181801    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-tls-assets\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181993 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181809    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc65t\" (UniqueName: \"kubernetes.io/projected/af2bc8ee-950a-433d-875b-88b92c1b1726-kube-api-access-hc65t\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.181993 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.181821    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af2bc8ee-950a-433d-875b-88b92c1b1726-config-out\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:34:50.421469 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.421386    2563 generic.go:356] "Generic (PLEG): container finished" podID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerID="fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c" exitCode=0
Jul 09 04:34:50.421469 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.421446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c"}
Jul 09 04:34:50.421469 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.421453    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.421684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.421507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af2bc8ee-950a-433d-875b-88b92c1b1726","Type":"ContainerDied","Data":"2fb94a95aeef4127a7f46209de26c14b52864031ab2a17dd6e9c05787a548629"}
Jul 09 04:34:50.421684 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.421553    2563 scope.go:117] "RemoveContainer" containerID="574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc"
Jul 09 04:34:50.429667 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.429604    2563 scope.go:117] "RemoveContainer" containerID="13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60"
Jul 09 04:34:50.436424 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.436408    2563 scope.go:117] "RemoveContainer" containerID="cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4"
Jul 09 04:34:50.443222 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.443202    2563 scope.go:117] "RemoveContainer" containerID="fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c"
Jul 09 04:34:50.444905 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.444884    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:34:50.451170 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.451115    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:34:50.469279 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.468957    2563 scope.go:117] "RemoveContainer" containerID="f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889"
Jul 09 04:34:50.481123 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481098    2563 scope.go:117] "RemoveContainer" containerID="521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343"
Jul 09 04:34:50.481215 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481142    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:34:50.481901 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481881    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="alertmanager"
Jul 09 04:34:50.481901 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481901    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="alertmanager"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481912    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="config-reloader"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481919    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="config-reloader"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481929    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-web"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481937    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-web"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481947    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481955    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481981    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-metric"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.481989    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-metric"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482001    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="prom-label-proxy"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482009    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="prom-label-proxy"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482018    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="init-config-reloader"
Jul 09 04:34:50.482042 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482026    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="init-config-reloader"
Jul 09 04:34:50.482429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482112    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-web"
Jul 09 04:34:50.482429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482127    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="prom-label-proxy"
Jul 09 04:34:50.482429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482137    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="alertmanager"
Jul 09 04:34:50.482429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482146    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="config-reloader"
Jul 09 04:34:50.482429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482155    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy"
Jul 09 04:34:50.482429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.482162    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" containerName="kube-rbac-proxy-metric"
Jul 09 04:34:50.488018 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.487997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.489985 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.489969    2563 scope.go:117] "RemoveContainer" containerID="c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3"
Jul 09 04:34:50.491215 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491142    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 04:34:50.491327 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491225    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 04:34:50.491327 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 04:34:50.491327 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491230    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 04:34:50.491610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491365    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vmp4l\""
Jul 09 04:34:50.491610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491142    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 04:34:50.491610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491497    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 04:34:50.491610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491556    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 04:34:50.491610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.491559    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 04:34:50.494478 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.494453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:34:50.496914 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.496736    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 04:34:50.500820 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.500799    2563 scope.go:117] "RemoveContainer" containerID="574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc"
Jul 09 04:34:50.501118 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:34:50.501099    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc\": container with ID starting with 574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc not found: ID does not exist" containerID="574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc"
Jul 09 04:34:50.501167 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501128    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc"} err="failed to get container status \"574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc\": rpc error: code = NotFound desc = could not find container \"574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc\": container with ID starting with 574c99fd6ba96c7ecf3a38577e2be6d89c5130eed5d8644d2b4b9b3a8fe415fc not found: ID does not exist"
Jul 09 04:34:50.501167 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501162    2563 scope.go:117] "RemoveContainer" containerID="13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60"
Jul 09 04:34:50.501405 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:34:50.501389    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60\": container with ID starting with 13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60 not found: ID does not exist" containerID="13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60"
Jul 09 04:34:50.501462 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501407    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60"} err="failed to get container status \"13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60\": rpc error: code = NotFound desc = could not find container \"13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60\": container with ID starting with 13c2fd298a4b8d807a97d9a446d90d56283e6d645d5105cc35a46f87b2da7b60 not found: ID does not exist"
Jul 09 04:34:50.501462 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501421    2563 scope.go:117] "RemoveContainer" containerID="cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4"
Jul 09 04:34:50.501636 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:34:50.501621    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4\": container with ID starting with cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4 not found: ID does not exist" containerID="cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4"
Jul 09 04:34:50.501703 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501653    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4"} err="failed to get container status \"cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4\": rpc error: code = NotFound desc = could not find container \"cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4\": container with ID starting with cc226a037015300686df3a117c3a03df1e379cf3b8a04def61b6f4b74c1f5de4 not found: ID does not exist"
Jul 09 04:34:50.501703 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501672    2563 scope.go:117] "RemoveContainer" containerID="fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c"
Jul 09 04:34:50.501924 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:34:50.501905    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c\": container with ID starting with fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c not found: ID does not exist" containerID="fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c"
Jul 09 04:34:50.501964 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501929    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c"} err="failed to get container status \"fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c\": rpc error: code = NotFound desc = could not find container \"fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c\": container with ID starting with fa70292c7c0f8ae3e2c5e2f5ba864cf0671211d193655f13e07047b566965c8c not found: ID does not exist"
Jul 09 04:34:50.501964 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.501943    2563 scope.go:117] "RemoveContainer" containerID="f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889"
Jul 09 04:34:50.502151 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:34:50.502136    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889\": container with ID starting with f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889 not found: ID does not exist" containerID="f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889"
Jul 09 04:34:50.502200 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.502154    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889"} err="failed to get container status \"f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889\": rpc error: code = NotFound desc = could not find container \"f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889\": container with ID starting with f3055b417bac49f1f9f8ffb8c5627985b3d1e8e33bfa4e6b1a1c0f5b4b352889 not found: ID does not exist"
Jul 09 04:34:50.502200 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.502166    2563 scope.go:117] "RemoveContainer" containerID="521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343"
Jul 09 04:34:50.502381 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:34:50.502363    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343\": container with ID starting with 521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343 not found: ID does not exist" containerID="521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343"
Jul 09 04:34:50.502417 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.502386    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343"} err="failed to get container status \"521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343\": rpc error: code = NotFound desc = could not find container \"521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343\": container with ID starting with 521062d045c142f3eb17fd363e779f87ae4dd93378107e2f55ac25a66cebf343 not found: ID does not exist"
Jul 09 04:34:50.502417 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.502402    2563 scope.go:117] "RemoveContainer" containerID="c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3"
Jul 09 04:34:50.502628 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:34:50.502614    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3\": container with ID starting with c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3 not found: ID does not exist" containerID="c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3"
Jul 09 04:34:50.502687 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.502632    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3"} err="failed to get container status \"c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3\": rpc error: code = NotFound desc = could not find container \"c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3\": container with ID starting with c87008558e6c97e73dd25638636589994ca5b8cbd10331ba2ce854d8b73182e3 not found: ID does not exist"
Jul 09 04:34:50.584763 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.584727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.584763 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.584766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.584974 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.584824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/765d304a-b49d-4a9c-9c1f-293c4bce4f55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.584974 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.584868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/765d304a-b49d-4a9c-9c1f-293c4bce4f55-config-out\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.584974 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.584904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.584974 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.584927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-web-config\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.585097 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.584975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/765d304a-b49d-4a9c-9c1f-293c4bce4f55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.585097 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.585003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.585097 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.585024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.585097 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.585041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765d304a-b49d-4a9c-9c1f-293c4bce4f55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.585097 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.585058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq57k\" (UniqueName: \"kubernetes.io/projected/765d304a-b49d-4a9c-9c1f-293c4bce4f55-kube-api-access-pq57k\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.585097 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.585083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/765d304a-b49d-4a9c-9c1f-293c4bce4f55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.585262 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.585133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-config-volume\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686236 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-config-volume\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686236 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686236 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686236 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/765d304a-b49d-4a9c-9c1f-293c4bce4f55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686576 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/765d304a-b49d-4a9c-9c1f-293c4bce4f55-config-out\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686576 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686576 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-web-config\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686576 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/765d304a-b49d-4a9c-9c1f-293c4bce4f55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686807 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686807 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686807 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765d304a-b49d-4a9c-9c1f-293c4bce4f55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686807 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq57k\" (UniqueName: \"kubernetes.io/projected/765d304a-b49d-4a9c-9c1f-293c4bce4f55-kube-api-access-pq57k\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.686807 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.686744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/765d304a-b49d-4a9c-9c1f-293c4bce4f55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.687468 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.687443    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/765d304a-b49d-4a9c-9c1f-293c4bce4f55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.689128 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.689099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/765d304a-b49d-4a9c-9c1f-293c4bce4f55-config-out\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.689370 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.689350    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/765d304a-b49d-4a9c-9c1f-293c4bce4f55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.689444 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.689374    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-config-volume\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.689444 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.689398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.689573 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.689499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.689708 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.689686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/765d304a-b49d-4a9c-9c1f-293c4bce4f55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.689796 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.689712    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.690101 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.690080    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765d304a-b49d-4a9c-9c1f-293c4bce4f55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.690170 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.690148    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.690234 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.690219    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.691243 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.691216    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/765d304a-b49d-4a9c-9c1f-293c4bce4f55-web-config\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.697540 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.697517    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq57k\" (UniqueName: \"kubernetes.io/projected/765d304a-b49d-4a9c-9c1f-293c4bce4f55-kube-api-access-pq57k\") pod \"alertmanager-main-0\" (UID: \"765d304a-b49d-4a9c-9c1f-293c4bce4f55\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.700321 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.700299    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2bc8ee-950a-433d-875b-88b92c1b1726" path="/var/lib/kubelet/pods/af2bc8ee-950a-433d-875b-88b92c1b1726/volumes"
Jul 09 04:34:50.799546 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.799503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 04:34:50.941990 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:50.941899    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 04:34:50.945326 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:34:50.945297    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765d304a_b49d_4a9c_9c1f_293c4bce4f55.slice/crio-2f080f1776a6b79dba1f1aa362538562dab61f3f9d631f3ac91bb64963e0ce1f WatchSource:0}: Error finding container 2f080f1776a6b79dba1f1aa362538562dab61f3f9d631f3ac91bb64963e0ce1f: Status 404 returned error can't find the container with id 2f080f1776a6b79dba1f1aa362538562dab61f3f9d631f3ac91bb64963e0ce1f
Jul 09 04:34:51.427584 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:51.427547    2563 generic.go:356] "Generic (PLEG): container finished" podID="765d304a-b49d-4a9c-9c1f-293c4bce4f55" containerID="7151a6465caafbf7fc50514efd981229ac36be168b36ab658d3aaa9b12dbd7a0" exitCode=0
Jul 09 04:34:51.427741 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:51.427635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerDied","Data":"7151a6465caafbf7fc50514efd981229ac36be168b36ab658d3aaa9b12dbd7a0"}
Jul 09 04:34:51.427741 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:51.427714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerStarted","Data":"2f080f1776a6b79dba1f1aa362538562dab61f3f9d631f3ac91bb64963e0ce1f"}
Jul 09 04:34:52.434361 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.434323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerStarted","Data":"fda54d3201e01120e56046da8e309c1a934be012c008820497036310c0537a46"}
Jul 09 04:34:52.434766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.434415    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerStarted","Data":"f14dd5d241496ce9922d47a71e6785f88016dfce44fd82dc145cf649d177efe1"}
Jul 09 04:34:52.434766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.434442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerStarted","Data":"e5a47afe3d913c212f1eb006a888fe3331caedaf5bcbf95fd58d193be0b63ec9"}
Jul 09 04:34:52.434766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.434466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerStarted","Data":"d47e7776b4a4008c71b790a8c02b532cec2a78123baca593ac045febf679d22f"}
Jul 09 04:34:52.434766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.434497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerStarted","Data":"e51fc36ef1b38a3a173d0c5ed249ae71b69407ca1ed24ce739b70ecb878f07b6"}
Jul 09 04:34:52.434766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.434524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"765d304a-b49d-4a9c-9c1f-293c4bce4f55","Type":"ContainerStarted","Data":"cca73a97631b6f75af41f1c390f385a14eb939b56ef1cda32352f145e5cb406d"}
Jul 09 04:34:52.459841 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.459785    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.440106505 podStartE2EDuration="2.459767966s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.661461ms" isStatefulPod=false podCreationTimestamp="2026-07-09 04:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:34:52.457812399 +0000 UTC m=+159.618232923" watchObservedRunningTime="2026-07-09 04:34:52.459767966 +0000 UTC m=+159.620188486"
Jul 09 04:34:52.675289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.675244    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"]
Jul 09 04:34:52.679325 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.679298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.682350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.682014    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 04:34:52.682350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.682081    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 04:34:52.682350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.682095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 04:34:52.682350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.682088    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 04:34:52.682350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.682122    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rmf54\""
Jul 09 04:34:52.682350 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.682081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 04:34:52.687451 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.687380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 04:34:52.691502 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.691477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"]
Jul 09 04:34:52.806617 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-telemeter-client-tls\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.806845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-serving-certs-ca-bundle\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.806845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-federate-client-tls\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.806845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-secret-telemeter-client\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.806845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.806845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9tz9\" (UniqueName: \"kubernetes.io/projected/cae54d10-84d3-4afc-82a1-dc2f910198bf-kube-api-access-v9tz9\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.807076 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.807076 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.806895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-metrics-client-ca\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.907584 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-serving-certs-ca-bundle\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.907764 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-federate-client-tls\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.907764 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-secret-telemeter-client\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.907764 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.907764 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9tz9\" (UniqueName: \"kubernetes.io/projected/cae54d10-84d3-4afc-82a1-dc2f910198bf-kube-api-access-v9tz9\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.907764 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.907764 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-metrics-client-ca\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.908075 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.907933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-telemeter-client-tls\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.908416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.908389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-serving-certs-ca-bundle\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.908506 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.908467    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-metrics-client-ca\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.908907 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.908882    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae54d10-84d3-4afc-82a1-dc2f910198bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.910438 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.910409    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.910523 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.910491    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-telemeter-client-tls\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.910565 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.910528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-secret-telemeter-client\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.910698 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.910680    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cae54d10-84d3-4afc-82a1-dc2f910198bf-federate-client-tls\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.914769 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.914748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9tz9\" (UniqueName: \"kubernetes.io/projected/cae54d10-84d3-4afc-82a1-dc2f910198bf-kube-api-access-v9tz9\") pod \"telemeter-client-6445d7d8dd-2wj8s\" (UID: \"cae54d10-84d3-4afc-82a1-dc2f910198bf\") " pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:52.992753 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:52.992429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"
Jul 09 04:34:53.147569 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:53.145861    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s"]
Jul 09 04:34:53.151356 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:34:53.151328    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae54d10_84d3_4afc_82a1_dc2f910198bf.slice/crio-4378f78a03a4a9d61018f69bbf9e02ab3cf9a9e6695d4564a2c0201de741f252 WatchSource:0}: Error finding container 4378f78a03a4a9d61018f69bbf9e02ab3cf9a9e6695d4564a2c0201de741f252: Status 404 returned error can't find the container with id 4378f78a03a4a9d61018f69bbf9e02ab3cf9a9e6695d4564a2c0201de741f252
Jul 09 04:34:53.439759 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:53.439674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s" event={"ID":"cae54d10-84d3-4afc-82a1-dc2f910198bf","Type":"ContainerStarted","Data":"4378f78a03a4a9d61018f69bbf9e02ab3cf9a9e6695d4564a2c0201de741f252"}
Jul 09 04:34:55.449275 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:55.449183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s" event={"ID":"cae54d10-84d3-4afc-82a1-dc2f910198bf","Type":"ContainerStarted","Data":"b6ee24b776297b14f1ec97b85973929ec766ec0e01efbaee071615aaafa40f04"}
Jul 09 04:34:55.449275 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:55.449245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s" event={"ID":"cae54d10-84d3-4afc-82a1-dc2f910198bf","Type":"ContainerStarted","Data":"784a7648c91b8ff67ba5f9acee3461681509c1dc9ddb77f9af4c7c84d48fafef"}
Jul 09 04:34:55.449275 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:55.449267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s" event={"ID":"cae54d10-84d3-4afc-82a1-dc2f910198bf","Type":"ContainerStarted","Data":"b431a4fce102757abfb76daf8b335c7968c5fef450896d43ee69788bd30b6c10"}
Jul 09 04:34:55.469740 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:34:55.469685    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6445d7d8dd-2wj8s" podStartSLOduration=1.5380483489999999 podStartE2EDuration="3.469669262s" totalImagesPullingTime="1.931620913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:34:55.468158419 +0000 UTC m=+162.628578941" watchObservedRunningTime="2026-07-09 04:34:55.469669262 +0000 UTC m=+162.630089773"
Jul 09 04:36:58.655638 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.655600    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"]
Jul 09 04:36:58.658982 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.658965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.661360 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.661338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dl7wj\""
Jul 09 04:36:58.661550 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.661528    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 04:36:58.662323 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.662306    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 04:36:58.667094 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.667072    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"]
Jul 09 04:36:58.747772 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.747723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.747937 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.747782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fxc\" (UniqueName: \"kubernetes.io/projected/877e6ffa-478f-48c4-a342-d754abb2f827-kube-api-access-p8fxc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.747937 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.747902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.849256 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.849215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.849256 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.849254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fxc\" (UniqueName: \"kubernetes.io/projected/877e6ffa-478f-48c4-a342-d754abb2f827-kube-api-access-p8fxc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.849531 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.849316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.849727 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.849705    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.849727 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.849716    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.857820 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.857793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fxc\" (UniqueName: \"kubernetes.io/projected/877e6ffa-478f-48c4-a342-d754abb2f827-kube-api-access-p8fxc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:58.969052 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:58.968963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:36:59.098277 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:59.098253    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"]
Jul 09 04:36:59.101030 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:36:59.101002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877e6ffa_478f_48c4_a342_d754abb2f827.slice/crio-57badbfc76ccfcc772c67711458252dba9d10992f00c829a40df5169750c3847 WatchSource:0}: Error finding container 57badbfc76ccfcc772c67711458252dba9d10992f00c829a40df5169750c3847: Status 404 returned error can't find the container with id 57badbfc76ccfcc772c67711458252dba9d10992f00c829a40df5169750c3847
Jul 09 04:36:59.909862 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:36:59.909822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp" event={"ID":"877e6ffa-478f-48c4-a342-d754abb2f827","Type":"ContainerStarted","Data":"57badbfc76ccfcc772c67711458252dba9d10992f00c829a40df5169750c3847"}
Jul 09 04:37:07.943287 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:07.943247    2563 generic.go:356] "Generic (PLEG): container finished" podID="877e6ffa-478f-48c4-a342-d754abb2f827" containerID="134bc4ad1f3a18f1ee678317b8a9bd2c939af3f22144af686a5ec81ac75fa6df" exitCode=0
Jul 09 04:37:07.943686 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:07.943338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp" event={"ID":"877e6ffa-478f-48c4-a342-d754abb2f827","Type":"ContainerDied","Data":"134bc4ad1f3a18f1ee678317b8a9bd2c939af3f22144af686a5ec81ac75fa6df"}
Jul 09 04:37:10.957096 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:10.957057    2563 generic.go:356] "Generic (PLEG): container finished" podID="877e6ffa-478f-48c4-a342-d754abb2f827" containerID="a544f1f14a4b2da61232ed549d8600944b0f6aa197f1ca185e531a6e912af96c" exitCode=0
Jul 09 04:37:10.957472 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:10.957140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp" event={"ID":"877e6ffa-478f-48c4-a342-d754abb2f827","Type":"ContainerDied","Data":"a544f1f14a4b2da61232ed549d8600944b0f6aa197f1ca185e531a6e912af96c"}
Jul 09 04:37:13.163823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:13.163793    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:37:13.164297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:13.164213    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:37:13.165885 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:13.165865    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 04:37:18.991765 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:18.991725    2563 generic.go:356] "Generic (PLEG): container finished" podID="877e6ffa-478f-48c4-a342-d754abb2f827" containerID="e2e190d50d2bf0e2123b8001005b8b627cb0dad3652fb9d9ebdeefd3e6fec430" exitCode=0
Jul 09 04:37:18.992174 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:18.991819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp" event={"ID":"877e6ffa-478f-48c4-a342-d754abb2f827","Type":"ContainerDied","Data":"e2e190d50d2bf0e2123b8001005b8b627cb0dad3652fb9d9ebdeefd3e6fec430"}
Jul 09 04:37:20.169445 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.169408    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:37:20.241188 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.241151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8fxc\" (UniqueName: \"kubernetes.io/projected/877e6ffa-478f-48c4-a342-d754abb2f827-kube-api-access-p8fxc\") pod \"877e6ffa-478f-48c4-a342-d754abb2f827\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") "
Jul 09 04:37:20.241188 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.241188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-bundle\") pod \"877e6ffa-478f-48c4-a342-d754abb2f827\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") "
Jul 09 04:37:20.241435 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.241247    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-util\") pod \"877e6ffa-478f-48c4-a342-d754abb2f827\" (UID: \"877e6ffa-478f-48c4-a342-d754abb2f827\") "
Jul 09 04:37:20.241913 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.241886    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-bundle" (OuterVolumeSpecName: "bundle") pod "877e6ffa-478f-48c4-a342-d754abb2f827" (UID: "877e6ffa-478f-48c4-a342-d754abb2f827"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:20.243456 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.243433    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877e6ffa-478f-48c4-a342-d754abb2f827-kube-api-access-p8fxc" (OuterVolumeSpecName: "kube-api-access-p8fxc") pod "877e6ffa-478f-48c4-a342-d754abb2f827" (UID: "877e6ffa-478f-48c4-a342-d754abb2f827"). InnerVolumeSpecName "kube-api-access-p8fxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:37:20.245400 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.245372    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-util" (OuterVolumeSpecName: "util") pod "877e6ffa-478f-48c4-a342-d754abb2f827" (UID: "877e6ffa-478f-48c4-a342-d754abb2f827"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:20.342219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.342182    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-util\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:37:20.342219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.342214    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8fxc\" (UniqueName: \"kubernetes.io/projected/877e6ffa-478f-48c4-a342-d754abb2f827-kube-api-access-p8fxc\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:37:20.342219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:20.342224    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/877e6ffa-478f-48c4-a342-d754abb2f827-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:37:21.001069 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:21.001027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp" event={"ID":"877e6ffa-478f-48c4-a342-d754abb2f827","Type":"ContainerDied","Data":"57badbfc76ccfcc772c67711458252dba9d10992f00c829a40df5169750c3847"}
Jul 09 04:37:21.001239 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:21.001077    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57badbfc76ccfcc772c67711458252dba9d10992f00c829a40df5169750c3847"
Jul 09 04:37:21.001239 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:21.001080    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxwkp"
Jul 09 04:37:26.617867 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.617831    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"]
Jul 09 04:37:26.618255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.618133    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877e6ffa-478f-48c4-a342-d754abb2f827" containerName="util"
Jul 09 04:37:26.618255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.618145    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="877e6ffa-478f-48c4-a342-d754abb2f827" containerName="util"
Jul 09 04:37:26.618255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.618157    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877e6ffa-478f-48c4-a342-d754abb2f827" containerName="extract"
Jul 09 04:37:26.618255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.618163    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="877e6ffa-478f-48c4-a342-d754abb2f827" containerName="extract"
Jul 09 04:37:26.618255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.618178    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877e6ffa-478f-48c4-a342-d754abb2f827" containerName="pull"
Jul 09 04:37:26.618255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.618183    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="877e6ffa-478f-48c4-a342-d754abb2f827" containerName="pull"
Jul 09 04:37:26.618255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.618226    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="877e6ffa-478f-48c4-a342-d754abb2f827" containerName="extract"
Jul 09 04:37:26.620671 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.620638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:26.623505 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.623475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lz6zd\""
Jul 09 04:37:26.623505 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.623500    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 04:37:26.623708 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.623501    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 04:37:26.632549 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.632520    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"]
Jul 09 04:37:26.692898 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.692860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4gdc\" (UniqueName: \"kubernetes.io/projected/0e50e69e-fa37-4e13-9a6d-5164c956cf11-kube-api-access-p4gdc\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9brc\" (UID: \"0e50e69e-fa37-4e13-9a6d-5164c956cf11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:26.693071 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.692923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e50e69e-fa37-4e13-9a6d-5164c956cf11-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9brc\" (UID: \"0e50e69e-fa37-4e13-9a6d-5164c956cf11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:26.794297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.794254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4gdc\" (UniqueName: \"kubernetes.io/projected/0e50e69e-fa37-4e13-9a6d-5164c956cf11-kube-api-access-p4gdc\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9brc\" (UID: \"0e50e69e-fa37-4e13-9a6d-5164c956cf11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:26.794508 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.794335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e50e69e-fa37-4e13-9a6d-5164c956cf11-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9brc\" (UID: \"0e50e69e-fa37-4e13-9a6d-5164c956cf11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:26.794680 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.794663    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e50e69e-fa37-4e13-9a6d-5164c956cf11-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9brc\" (UID: \"0e50e69e-fa37-4e13-9a6d-5164c956cf11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:26.802435 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.802409    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4gdc\" (UniqueName: \"kubernetes.io/projected/0e50e69e-fa37-4e13-9a6d-5164c956cf11-kube-api-access-p4gdc\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9brc\" (UID: \"0e50e69e-fa37-4e13-9a6d-5164c956cf11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:26.929623 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:26.929525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"
Jul 09 04:37:27.068289 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:27.068252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc"]
Jul 09 04:37:27.072623 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:37:27.072596    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e50e69e_fa37_4e13_9a6d_5164c956cf11.slice/crio-5ddc72526f47206aaf5a59b0f8ed4a3a205bb62a88082e2f4f2a3dec590c1a47 WatchSource:0}: Error finding container 5ddc72526f47206aaf5a59b0f8ed4a3a205bb62a88082e2f4f2a3dec590c1a47: Status 404 returned error can't find the container with id 5ddc72526f47206aaf5a59b0f8ed4a3a205bb62a88082e2f4f2a3dec590c1a47
Jul 09 04:37:27.075391 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:27.075367    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:37:28.030991 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:28.030954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc" event={"ID":"0e50e69e-fa37-4e13-9a6d-5164c956cf11","Type":"ContainerStarted","Data":"5ddc72526f47206aaf5a59b0f8ed4a3a205bb62a88082e2f4f2a3dec590c1a47"}
Jul 09 04:37:29.037725 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:29.037679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc" event={"ID":"0e50e69e-fa37-4e13-9a6d-5164c956cf11","Type":"ContainerStarted","Data":"9dfc6d58fefce38d3526ac9195c7f47a54802f5dbe6a6124f5177b26b4c9ff39"}
Jul 09 04:37:29.058314 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:29.058255    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9brc" podStartSLOduration=1.431907426 podStartE2EDuration="3.058241265s" totalImagesPullingTime="1.626333839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:37:29.056282806 +0000 UTC m=+316.216703340" watchObservedRunningTime="2026-07-09 04:37:29.058241265 +0000 UTC m=+316.218661785"
Jul 09 04:37:30.501234 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.501198    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"]
Jul 09 04:37:30.504775 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.504757    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.507324 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.507307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 04:37:30.508120 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.508100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dl7wj\""
Jul 09 04:37:30.508236 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.508122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 04:37:30.515336 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.515309    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"]
Jul 09 04:37:30.616268 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.616232    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tvsm9"]
Jul 09 04:37:30.619525 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.619505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.622015 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.621993    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 04:37:30.622133 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.622022    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 04:37:30.622133 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.622022    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gmjhb\""
Jul 09 04:37:30.628758 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.628736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tvsm9"]
Jul 09 04:37:30.629045 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.629031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.629102 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.629066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.629102 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.629090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cgx2\" (UniqueName: \"kubernetes.io/projected/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-kube-api-access-9cgx2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.729769 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.729728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.729963 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.729777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cgx2\" (UniqueName: \"kubernetes.io/projected/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-kube-api-access-9cgx2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.729963 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.729839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq8ln\" (UniqueName: \"kubernetes.io/projected/632d5539-63a9-4050-9b91-6846909f27f6-kube-api-access-qq8ln\") pod \"cert-manager-webhook-6486ffd997-tvsm9\" (UID: \"632d5539-63a9-4050-9b91-6846909f27f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.729963 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.729871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.730127 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.729965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/632d5539-63a9-4050-9b91-6846909f27f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tvsm9\" (UID: \"632d5539-63a9-4050-9b91-6846909f27f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.730209 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.730187    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.730255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.730230    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.737615 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.737589    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cgx2\" (UniqueName: \"kubernetes.io/projected/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-kube-api-access-9cgx2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.813727 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.813619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:30.830605 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.830578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq8ln\" (UniqueName: \"kubernetes.io/projected/632d5539-63a9-4050-9b91-6846909f27f6-kube-api-access-qq8ln\") pod \"cert-manager-webhook-6486ffd997-tvsm9\" (UID: \"632d5539-63a9-4050-9b91-6846909f27f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.830748 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.830621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/632d5539-63a9-4050-9b91-6846909f27f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tvsm9\" (UID: \"632d5539-63a9-4050-9b91-6846909f27f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.839116 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.839084    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq8ln\" (UniqueName: \"kubernetes.io/projected/632d5539-63a9-4050-9b91-6846909f27f6-kube-api-access-qq8ln\") pod \"cert-manager-webhook-6486ffd997-tvsm9\" (UID: \"632d5539-63a9-4050-9b91-6846909f27f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.839255 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.839087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/632d5539-63a9-4050-9b91-6846909f27f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tvsm9\" (UID: \"632d5539-63a9-4050-9b91-6846909f27f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.928748 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.928706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:30.944235 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:30.944214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"]
Jul 09 04:37:30.947195 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:37:30.947169    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a3b8cd_40fa_406f_a689_d67f7041c1b2.slice/crio-5e0eef090124a9421463d1f330c586c2a2d67d0c323413c1964e5e524b1cdf09 WatchSource:0}: Error finding container 5e0eef090124a9421463d1f330c586c2a2d67d0c323413c1964e5e524b1cdf09: Status 404 returned error can't find the container with id 5e0eef090124a9421463d1f330c586c2a2d67d0c323413c1964e5e524b1cdf09
Jul 09 04:37:31.049371 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:31.049326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5" event={"ID":"d5a3b8cd-40fa-406f-a689-d67f7041c1b2","Type":"ContainerStarted","Data":"4d8740677b327c16e372ce29580754a06bf0019a7cba905d88324c9b47ca5d81"}
Jul 09 04:37:31.049518 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:31.049397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5" event={"ID":"d5a3b8cd-40fa-406f-a689-d67f7041c1b2","Type":"ContainerStarted","Data":"5e0eef090124a9421463d1f330c586c2a2d67d0c323413c1964e5e524b1cdf09"}
Jul 09 04:37:31.064898 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:31.064873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tvsm9"]
Jul 09 04:37:31.085769 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:37:31.085735    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod632d5539_63a9_4050_9b91_6846909f27f6.slice/crio-b1981f6f8a24f127751bccbdbb5dbfe50f37c2ef2d1bb85b7d9d789a72772694 WatchSource:0}: Error finding container b1981f6f8a24f127751bccbdbb5dbfe50f37c2ef2d1bb85b7d9d789a72772694: Status 404 returned error can't find the container with id b1981f6f8a24f127751bccbdbb5dbfe50f37c2ef2d1bb85b7d9d789a72772694
Jul 09 04:37:32.055713 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:32.055673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9" event={"ID":"632d5539-63a9-4050-9b91-6846909f27f6","Type":"ContainerStarted","Data":"b1981f6f8a24f127751bccbdbb5dbfe50f37c2ef2d1bb85b7d9d789a72772694"}
Jul 09 04:37:32.057401 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:32.057368    2563 generic.go:356] "Generic (PLEG): container finished" podID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerID="4d8740677b327c16e372ce29580754a06bf0019a7cba905d88324c9b47ca5d81" exitCode=0
Jul 09 04:37:32.057538 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:32.057438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5" event={"ID":"d5a3b8cd-40fa-406f-a689-d67f7041c1b2","Type":"ContainerDied","Data":"4d8740677b327c16e372ce29580754a06bf0019a7cba905d88324c9b47ca5d81"}
Jul 09 04:37:35.072810 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:35.072769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9" event={"ID":"632d5539-63a9-4050-9b91-6846909f27f6","Type":"ContainerStarted","Data":"05937972ec05b9ad5d5939a3025b23ec6ce8cbc1165668157b0cc6a72268998a"}
Jul 09 04:37:35.072810 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:35.072816    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:35.074595 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:35.074563    2563 generic.go:356] "Generic (PLEG): container finished" podID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerID="0f600d1bda9a939a32facdc141b8c1b39eb3b53e53fc51bba7f54dc5a58a91f4" exitCode=0
Jul 09 04:37:35.074735 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:35.074638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5" event={"ID":"d5a3b8cd-40fa-406f-a689-d67f7041c1b2","Type":"ContainerDied","Data":"0f600d1bda9a939a32facdc141b8c1b39eb3b53e53fc51bba7f54dc5a58a91f4"}
Jul 09 04:37:35.089324 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:35.089283    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9" podStartSLOduration=1.670528192 podStartE2EDuration="5.089269093s" totalImagesPullingTime="3.418740901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:37:35.088515369 +0000 UTC m=+322.248935890" watchObservedRunningTime="2026-07-09 04:37:35.089269093 +0000 UTC m=+322.249689614"
Jul 09 04:37:36.080564 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:36.080522    2563 generic.go:356] "Generic (PLEG): container finished" podID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerID="b8364422527a0826400a9872304a756ead9e2031c51d95b165a14272f53063a1" exitCode=0
Jul 09 04:37:36.080972 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:36.080610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5" event={"ID":"d5a3b8cd-40fa-406f-a689-d67f7041c1b2","Type":"ContainerDied","Data":"b8364422527a0826400a9872304a756ead9e2031c51d95b165a14272f53063a1"}
Jul 09 04:37:37.210771 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.210745    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:37.401321 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.401210    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-bundle\") pod \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") "
Jul 09 04:37:37.401321 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.401267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-util\") pod \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") "
Jul 09 04:37:37.401321 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.401305    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cgx2\" (UniqueName: \"kubernetes.io/projected/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-kube-api-access-9cgx2\") pod \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\" (UID: \"d5a3b8cd-40fa-406f-a689-d67f7041c1b2\") "
Jul 09 04:37:37.401703 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.401678    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-bundle" (OuterVolumeSpecName: "bundle") pod "d5a3b8cd-40fa-406f-a689-d67f7041c1b2" (UID: "d5a3b8cd-40fa-406f-a689-d67f7041c1b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:37.403426 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.403406    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-kube-api-access-9cgx2" (OuterVolumeSpecName: "kube-api-access-9cgx2") pod "d5a3b8cd-40fa-406f-a689-d67f7041c1b2" (UID: "d5a3b8cd-40fa-406f-a689-d67f7041c1b2"). InnerVolumeSpecName "kube-api-access-9cgx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:37:37.406965 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.406939    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-util" (OuterVolumeSpecName: "util") pod "d5a3b8cd-40fa-406f-a689-d67f7041c1b2" (UID: "d5a3b8cd-40fa-406f-a689-d67f7041c1b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:37.502912 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.502882    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:37:37.502912 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.502908    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-util\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:37:37.502912 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:37.502918    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cgx2\" (UniqueName: \"kubernetes.io/projected/d5a3b8cd-40fa-406f-a689-d67f7041c1b2-kube-api-access-9cgx2\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:37:38.091452 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:38.091414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5" event={"ID":"d5a3b8cd-40fa-406f-a689-d67f7041c1b2","Type":"ContainerDied","Data":"5e0eef090124a9421463d1f330c586c2a2d67d0c323413c1964e5e524b1cdf09"}
Jul 09 04:37:38.091452 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:38.091440    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4mnc5"
Jul 09 04:37:38.091691 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:38.091467    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e0eef090124a9421463d1f330c586c2a2d67d0c323413c1964e5e524b1cdf09"
Jul 09 04:37:41.082939 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:41.082909    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tvsm9"
Jul 09 04:37:42.173413 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kbmfv"]
Jul 09 04:37:42.173813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173728    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerName="util"
Jul 09 04:37:42.173813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173742    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerName="util"
Jul 09 04:37:42.173813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173756    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerName="pull"
Jul 09 04:37:42.173813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173762    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerName="pull"
Jul 09 04:37:42.173813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173778    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerName="extract"
Jul 09 04:37:42.173813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173785    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerName="extract"
Jul 09 04:37:42.173987 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.173837    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a3b8cd-40fa-406f-a689-d67f7041c1b2" containerName="extract"
Jul 09 04:37:42.177975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.177959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.180337 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.180314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pv7f5\""
Jul 09 04:37:42.185541 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.185518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kbmfv"]
Jul 09 04:37:42.241222 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.241182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ldfd\" (UniqueName: \"kubernetes.io/projected/ecb85333-6688-4c7d-8123-5a2aab98e35b-kube-api-access-2ldfd\") pod \"cert-manager-55b4d954d5-kbmfv\" (UID: \"ecb85333-6688-4c7d-8123-5a2aab98e35b\") " pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.241404 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.241249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb85333-6688-4c7d-8123-5a2aab98e35b-bound-sa-token\") pod \"cert-manager-55b4d954d5-kbmfv\" (UID: \"ecb85333-6688-4c7d-8123-5a2aab98e35b\") " pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.342081 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.342044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ldfd\" (UniqueName: \"kubernetes.io/projected/ecb85333-6688-4c7d-8123-5a2aab98e35b-kube-api-access-2ldfd\") pod \"cert-manager-55b4d954d5-kbmfv\" (UID: \"ecb85333-6688-4c7d-8123-5a2aab98e35b\") " pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.342081 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.342083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb85333-6688-4c7d-8123-5a2aab98e35b-bound-sa-token\") pod \"cert-manager-55b4d954d5-kbmfv\" (UID: \"ecb85333-6688-4c7d-8123-5a2aab98e35b\") " pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.350032 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.350004    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb85333-6688-4c7d-8123-5a2aab98e35b-bound-sa-token\") pod \"cert-manager-55b4d954d5-kbmfv\" (UID: \"ecb85333-6688-4c7d-8123-5a2aab98e35b\") " pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.350175 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.350074    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ldfd\" (UniqueName: \"kubernetes.io/projected/ecb85333-6688-4c7d-8123-5a2aab98e35b-kube-api-access-2ldfd\") pod \"cert-manager-55b4d954d5-kbmfv\" (UID: \"ecb85333-6688-4c7d-8123-5a2aab98e35b\") " pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.487771 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.487739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kbmfv"
Jul 09 04:37:42.615753 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:42.615727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kbmfv"]
Jul 09 04:37:42.618402 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:37:42.618375    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecb85333_6688_4c7d_8123_5a2aab98e35b.slice/crio-808fdc61243fa17693d57b09c48578b5d5cf544e44d98e6eb645104202f9fcad WatchSource:0}: Error finding container 808fdc61243fa17693d57b09c48578b5d5cf544e44d98e6eb645104202f9fcad: Status 404 returned error can't find the container with id 808fdc61243fa17693d57b09c48578b5d5cf544e44d98e6eb645104202f9fcad
Jul 09 04:37:43.116340 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:43.116305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kbmfv" event={"ID":"ecb85333-6688-4c7d-8123-5a2aab98e35b","Type":"ContainerStarted","Data":"084ab7eb40a09ffe04b69eebce734c53493152a636c0c0627a07940deb581472"}
Jul 09 04:37:43.116340 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:43.116347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kbmfv" event={"ID":"ecb85333-6688-4c7d-8123-5a2aab98e35b","Type":"ContainerStarted","Data":"808fdc61243fa17693d57b09c48578b5d5cf544e44d98e6eb645104202f9fcad"}
Jul 09 04:37:43.130907 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:43.130860    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kbmfv" podStartSLOduration=1.130845781 podStartE2EDuration="1.130845781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:37:43.130135968 +0000 UTC m=+330.290556487" watchObservedRunningTime="2026-07-09 04:37:43.130845781 +0000 UTC m=+330.291266300"
Jul 09 04:37:56.345975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.345937    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"]
Jul 09 04:37:56.352773 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.352753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.355746 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.355711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 04:37:56.355886 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.355766    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 04:37:56.355886 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.355721    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dl7wj\""
Jul 09 04:37:56.356160 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.356140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"]
Jul 09 04:37:56.448265 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.448228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h58ck\" (UniqueName: \"kubernetes.io/projected/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-kube-api-access-h58ck\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.448480 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.448280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.448480 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.448435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.549219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.549181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.549416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.549248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.549416 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.549279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h58ck\" (UniqueName: \"kubernetes.io/projected/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-kube-api-access-h58ck\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.549668 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.549623    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.549757 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.549693    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.557352 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.557317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h58ck\" (UniqueName: \"kubernetes.io/projected/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-kube-api-access-h58ck\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.663710 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.663600    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:37:56.794626 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:56.794600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"]
Jul 09 04:37:56.797151 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:37:56.797125    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e943aa_2ed6_4760_9ac1_2bb7c81078d8.slice/crio-e907a40826ccbb11b4892ba90731c413847b3881a4c90155779416301b77278c WatchSource:0}: Error finding container e907a40826ccbb11b4892ba90731c413847b3881a4c90155779416301b77278c: Status 404 returned error can't find the container with id e907a40826ccbb11b4892ba90731c413847b3881a4c90155779416301b77278c
Jul 09 04:37:57.183097 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:57.183058    2563 generic.go:356] "Generic (PLEG): container finished" podID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerID="a21c26ffceba280135e8f6c5db233ff52adb640534530e1a9c459b2f86e1c3a5" exitCode=0
Jul 09 04:37:57.183288 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:57.183144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4" event={"ID":"15e943aa-2ed6-4760-9ac1-2bb7c81078d8","Type":"ContainerDied","Data":"a21c26ffceba280135e8f6c5db233ff52adb640534530e1a9c459b2f86e1c3a5"}
Jul 09 04:37:57.183288 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:57.183205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4" event={"ID":"15e943aa-2ed6-4760-9ac1-2bb7c81078d8","Type":"ContainerStarted","Data":"e907a40826ccbb11b4892ba90731c413847b3881a4c90155779416301b77278c"}
Jul 09 04:37:58.189185 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:58.189093    2563 generic.go:356] "Generic (PLEG): container finished" podID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerID="bbf97519a2d04417ddf955f444a433bda43f8d512a19e21c6000d9f4df7592f2" exitCode=0
Jul 09 04:37:58.189613 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:58.189179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4" event={"ID":"15e943aa-2ed6-4760-9ac1-2bb7c81078d8","Type":"ContainerDied","Data":"bbf97519a2d04417ddf955f444a433bda43f8d512a19e21c6000d9f4df7592f2"}
Jul 09 04:37:59.196326 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:59.196287    2563 generic.go:356] "Generic (PLEG): container finished" podID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerID="355fd83bb3c6c8267d2c6fad1b3fb9a4551d4859201d3005e9774485f832b2dc" exitCode=0
Jul 09 04:37:59.196800 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:37:59.196365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4" event={"ID":"15e943aa-2ed6-4760-9ac1-2bb7c81078d8","Type":"ContainerDied","Data":"355fd83bb3c6c8267d2c6fad1b3fb9a4551d4859201d3005e9774485f832b2dc"}
Jul 09 04:38:00.343713 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.343688    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:38:00.392278 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.392236    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-util\") pod \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") "
Jul 09 04:38:00.392455 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.392293    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h58ck\" (UniqueName: \"kubernetes.io/projected/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-kube-api-access-h58ck\") pod \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") "
Jul 09 04:38:00.392455 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.392387    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-bundle\") pod \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\" (UID: \"15e943aa-2ed6-4760-9ac1-2bb7c81078d8\") "
Jul 09 04:38:00.393115 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.393085    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-bundle" (OuterVolumeSpecName: "bundle") pod "15e943aa-2ed6-4760-9ac1-2bb7c81078d8" (UID: "15e943aa-2ed6-4760-9ac1-2bb7c81078d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:38:00.394544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.394508    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-kube-api-access-h58ck" (OuterVolumeSpecName: "kube-api-access-h58ck") pod "15e943aa-2ed6-4760-9ac1-2bb7c81078d8" (UID: "15e943aa-2ed6-4760-9ac1-2bb7c81078d8"). InnerVolumeSpecName "kube-api-access-h58ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:38:00.398469 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.398440    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-util" (OuterVolumeSpecName: "util") pod "15e943aa-2ed6-4760-9ac1-2bb7c81078d8" (UID: "15e943aa-2ed6-4760-9ac1-2bb7c81078d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:38:00.493932 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.493899    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:38:00.493932 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.493929    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-util\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:38:00.493932 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:00.493938    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h58ck\" (UniqueName: \"kubernetes.io/projected/15e943aa-2ed6-4760-9ac1-2bb7c81078d8-kube-api-access-h58ck\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:38:01.207103 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:01.207071    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4"
Jul 09 04:38:01.207103 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:01.207088    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54th4" event={"ID":"15e943aa-2ed6-4760-9ac1-2bb7c81078d8","Type":"ContainerDied","Data":"e907a40826ccbb11b4892ba90731c413847b3881a4c90155779416301b77278c"}
Jul 09 04:38:01.207366 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:01.207131    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e907a40826ccbb11b4892ba90731c413847b3881a4c90155779416301b77278c"
Jul 09 04:38:05.066187 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.066114    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"]
Jul 09 04:38:05.071757 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.071724    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerName="extract"
Jul 09 04:38:05.071757 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.071752    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerName="extract"
Jul 09 04:38:05.071975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.071771    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerName="util"
Jul 09 04:38:05.071975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.071776    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerName="util"
Jul 09 04:38:05.071975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.071786    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerName="pull"
Jul 09 04:38:05.071975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.071791    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerName="pull"
Jul 09 04:38:05.071975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.071852    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e943aa-2ed6-4760-9ac1-2bb7c81078d8" containerName="extract"
Jul 09 04:38:05.075108 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.075089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.079426 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.079400    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 04:38:05.079596 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.079584    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 04:38:05.080401 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.080378    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 04:38:05.080550 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.080459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 04:38:05.080622 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.080594    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 04:38:05.084003 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.083987    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wlsjh\""
Jul 09 04:38:05.093605 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.093583    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"]
Jul 09 04:38:05.133146 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.133109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d5688ab-3a93-404a-8b66-73f9f3468bc9-manager-config\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.133335 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.133181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l27f\" (UniqueName: \"kubernetes.io/projected/2d5688ab-3a93-404a-8b66-73f9f3468bc9-kube-api-access-9l27f\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.133335 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.133259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d5688ab-3a93-404a-8b66-73f9f3468bc9-metrics-cert\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.133335 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.133304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d5688ab-3a93-404a-8b66-73f9f3468bc9-cert\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.234489 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.234460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l27f\" (UniqueName: \"kubernetes.io/projected/2d5688ab-3a93-404a-8b66-73f9f3468bc9-kube-api-access-9l27f\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.234706 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.234504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d5688ab-3a93-404a-8b66-73f9f3468bc9-metrics-cert\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.234706 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.234527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d5688ab-3a93-404a-8b66-73f9f3468bc9-cert\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.234706 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.234544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d5688ab-3a93-404a-8b66-73f9f3468bc9-manager-config\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.235203 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.235175    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d5688ab-3a93-404a-8b66-73f9f3468bc9-manager-config\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.237004 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.236981    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d5688ab-3a93-404a-8b66-73f9f3468bc9-metrics-cert\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.237105 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.237061    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d5688ab-3a93-404a-8b66-73f9f3468bc9-cert\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.242482 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.242454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l27f\" (UniqueName: \"kubernetes.io/projected/2d5688ab-3a93-404a-8b66-73f9f3468bc9-kube-api-access-9l27f\") pod \"lws-controller-manager-5895bc645c-srk5g\" (UID: \"2d5688ab-3a93-404a-8b66-73f9f3468bc9\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.384085 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.383993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:05.523182 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:05.523115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"]
Jul 09 04:38:05.525863 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:38:05.525832    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5688ab_3a93_404a_8b66_73f9f3468bc9.slice/crio-1aa1148a1ce2d1e27efa5b137d2fc664c10024cea18ad600e331cf5145847e26 WatchSource:0}: Error finding container 1aa1148a1ce2d1e27efa5b137d2fc664c10024cea18ad600e331cf5145847e26: Status 404 returned error can't find the container with id 1aa1148a1ce2d1e27efa5b137d2fc664c10024cea18ad600e331cf5145847e26
Jul 09 04:38:06.230331 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:06.230293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g" event={"ID":"2d5688ab-3a93-404a-8b66-73f9f3468bc9","Type":"ContainerStarted","Data":"1aa1148a1ce2d1e27efa5b137d2fc664c10024cea18ad600e331cf5145847e26"}
Jul 09 04:38:07.238338 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:07.238302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g" event={"ID":"2d5688ab-3a93-404a-8b66-73f9f3468bc9","Type":"ContainerStarted","Data":"6fac292c3a9d1ce7b310e9cec225477840edd213965f314789b549464ae81df4"}
Jul 09 04:38:07.238741 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:07.238420    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:07.257419 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:07.257369    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g" podStartSLOduration=0.678384686 podStartE2EDuration="2.257351521s" totalImagesPullingTime="1.578966835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:38:07.255620749 +0000 UTC m=+354.416041270" watchObservedRunningTime="2026-07-09 04:38:07.257351521 +0000 UTC m=+354.417772042"
Jul 09 04:38:08.371950 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.371921    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"]
Jul 09 04:38:08.375368 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.375350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.378904 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.378880    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 04:38:08.378904 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.378895    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 04:38:08.379070 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.378993    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 04:38:08.379322 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.379304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 04:38:08.391219 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.391188    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w4cln\""
Jul 09 04:38:08.406309 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.406274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"]
Jul 09 04:38:08.463984 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.463942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93053eac-31a5-4383-8f9e-565627f4e01a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.463984 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.463986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxhw\" (UniqueName: \"kubernetes.io/projected/93053eac-31a5-4383-8f9e-565627f4e01a-kube-api-access-2nxhw\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.464166 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.464007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93053eac-31a5-4383-8f9e-565627f4e01a-tmp\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.464166 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.464059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93053eac-31a5-4383-8f9e-565627f4e01a-manifests\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.464166 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.464077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93053eac-31a5-4383-8f9e-565627f4e01a-webhook-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.565285 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.565241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93053eac-31a5-4383-8f9e-565627f4e01a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.565285 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.565286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxhw\" (UniqueName: \"kubernetes.io/projected/93053eac-31a5-4383-8f9e-565627f4e01a-kube-api-access-2nxhw\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.565524 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.565310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93053eac-31a5-4383-8f9e-565627f4e01a-tmp\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.565524 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.565348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93053eac-31a5-4383-8f9e-565627f4e01a-manifests\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.565524 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.565375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93053eac-31a5-4383-8f9e-565627f4e01a-webhook-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.565902 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.565877    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93053eac-31a5-4383-8f9e-565627f4e01a-manifests\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.567689 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.567665    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93053eac-31a5-4383-8f9e-565627f4e01a-tmp\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.567808 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.567787    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93053eac-31a5-4383-8f9e-565627f4e01a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.567885 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.567797    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93053eac-31a5-4383-8f9e-565627f4e01a-webhook-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.578852 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.578822    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxhw\" (UniqueName: \"kubernetes.io/projected/93053eac-31a5-4383-8f9e-565627f4e01a-kube-api-access-2nxhw\") pod \"opendatahub-operator-controller-manager-94ccb68c4-cqmwf\" (UID: \"93053eac-31a5-4383-8f9e-565627f4e01a\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.685934 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.685842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:08.836743 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:08.836716    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"]
Jul 09 04:38:08.839151 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:38:08.839119    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93053eac_31a5_4383_8f9e_565627f4e01a.slice/crio-3b418895f35d86e710914d51253fae22e68405285572f2fc4d6eb75af5a5bb5f WatchSource:0}: Error finding container 3b418895f35d86e710914d51253fae22e68405285572f2fc4d6eb75af5a5bb5f: Status 404 returned error can't find the container with id 3b418895f35d86e710914d51253fae22e68405285572f2fc4d6eb75af5a5bb5f
Jul 09 04:38:09.248380 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:09.248339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf" event={"ID":"93053eac-31a5-4383-8f9e-565627f4e01a","Type":"ContainerStarted","Data":"3b418895f35d86e710914d51253fae22e68405285572f2fc4d6eb75af5a5bb5f"}
Jul 09 04:38:12.264072 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:12.264024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf" event={"ID":"93053eac-31a5-4383-8f9e-565627f4e01a","Type":"ContainerStarted","Data":"dddc585250e75b7f1ae061e6dcdbf63f7e5505c620699ade2e6a9be15d79d3f5"}
Jul 09 04:38:13.270638 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:13.270599    2563 generic.go:356] "Generic (PLEG): container finished" podID="93053eac-31a5-4383-8f9e-565627f4e01a" containerID="dddc585250e75b7f1ae061e6dcdbf63f7e5505c620699ade2e6a9be15d79d3f5" exitCode=0
Jul 09 04:38:13.271051 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:13.270678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf" event={"ID":"93053eac-31a5-4383-8f9e-565627f4e01a","Type":"ContainerDied","Data":"dddc585250e75b7f1ae061e6dcdbf63f7e5505c620699ade2e6a9be15d79d3f5"}
Jul 09 04:38:14.278480 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:14.278428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf" event={"ID":"93053eac-31a5-4383-8f9e-565627f4e01a","Type":"ContainerStarted","Data":"b00140221a55ff794d27219d22c8ffb8f22a168e852423be6d8d660731803eee"}
Jul 09 04:38:14.278950 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:14.278656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:14.300249 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:14.299347    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf" podStartSLOduration=1.6482573839999999 podStartE2EDuration="6.299322437s" totalImagesPullingTime="3.618609858s" totalInitContainerRuntime="1.032455195s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:38:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:38:14.297472683 +0000 UTC m=+361.457893208" watchObservedRunningTime="2026-07-09 04:38:14.299322437 +0000 UTC m=+361.459742960"
Jul 09 04:38:18.245322 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:18.245285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-srk5g"
Jul 09 04:38:25.285945 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:25.285906    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:38:28.298269 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.298222    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"]
Jul 09 04:38:28.313596 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.313564    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.316529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.316495    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 04:38:28.316529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.316495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 04:38:28.316861 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.316842    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 04:38:28.317466 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.317451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 04:38:28.318465 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.318450    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vct28\""
Jul 09 04:38:28.336166 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.336134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"]
Jul 09 04:38:28.457633 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.457593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqqd\" (UniqueName: \"kubernetes.io/projected/adc85dae-c570-4b52-96bf-b0321648ac0e-kube-api-access-rqqqd\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.457835 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.457683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adc85dae-c570-4b52-96bf-b0321648ac0e-tmp\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.457835 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.457738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adc85dae-c570-4b52-96bf-b0321648ac0e-tls-certs\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.559099 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.559007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqqd\" (UniqueName: \"kubernetes.io/projected/adc85dae-c570-4b52-96bf-b0321648ac0e-kube-api-access-rqqqd\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.559099 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.559060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adc85dae-c570-4b52-96bf-b0321648ac0e-tmp\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.559290 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.559103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adc85dae-c570-4b52-96bf-b0321648ac0e-tls-certs\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.561512 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.561483    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adc85dae-c570-4b52-96bf-b0321648ac0e-tmp\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.561845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.561822    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adc85dae-c570-4b52-96bf-b0321648ac0e-tls-certs\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.567449 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.567414    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqqd\" (UniqueName: \"kubernetes.io/projected/adc85dae-c570-4b52-96bf-b0321648ac0e-kube-api-access-rqqqd\") pod \"kube-auth-proxy-7c47bc47d8-9nd5l\" (UID: \"adc85dae-c570-4b52-96bf-b0321648ac0e\") " pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.623608 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.623566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"
Jul 09 04:38:28.779610 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:28.779577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l"]
Jul 09 04:38:28.781890 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:38:28.781858    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc85dae_c570_4b52_96bf_b0321648ac0e.slice/crio-9820838c2031498aecea9f5b3b0d2d94eb03310ba19e93ffa3473d08279243bc WatchSource:0}: Error finding container 9820838c2031498aecea9f5b3b0d2d94eb03310ba19e93ffa3473d08279243bc: Status 404 returned error can't find the container with id 9820838c2031498aecea9f5b3b0d2d94eb03310ba19e93ffa3473d08279243bc
Jul 09 04:38:29.351275 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:29.351237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l" event={"ID":"adc85dae-c570-4b52-96bf-b0321648ac0e","Type":"ContainerStarted","Data":"9820838c2031498aecea9f5b3b0d2d94eb03310ba19e93ffa3473d08279243bc"}
Jul 09 04:38:32.369258 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:32.369223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l" event={"ID":"adc85dae-c570-4b52-96bf-b0321648ac0e","Type":"ContainerStarted","Data":"cc0389f837a3d5c7f92f508cede07f1cca80bdf927ba751fced5946398bac90d"}
Jul 09 04:38:32.386677 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:38:32.386606    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c47bc47d8-9nd5l" podStartSLOduration=1.575202183 podStartE2EDuration="4.386589121s" totalImagesPullingTime="2.811386938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:38:32.38417361 +0000 UTC m=+379.544594131" watchObservedRunningTime="2026-07-09 04:38:32.386589121 +0000 UTC m=+379.547009691"
Jul 09 04:39:44.229411 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.229333    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"]
Jul 09 04:39:44.232892 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.232874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.235263 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.235233    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 04:39:44.235393 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.235363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 04:39:44.235514 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.235442    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ckvp2\""
Jul 09 04:39:44.240685 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.240536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"]
Jul 09 04:39:44.326316 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.326276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtrt\" (UniqueName: \"kubernetes.io/projected/496fb746-9237-41c9-8d4d-4bff5ee8d63a-kube-api-access-2vtrt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.326316 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.326322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.326565 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.326365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.427782 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.427749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.427967 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.427811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.427967 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.427909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtrt\" (UniqueName: \"kubernetes.io/projected/496fb746-9237-41c9-8d4d-4bff5ee8d63a-kube-api-access-2vtrt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.428165 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.428143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.428241 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.428167    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.436018 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.435994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtrt\" (UniqueName: \"kubernetes.io/projected/496fb746-9237-41c9-8d4d-4bff5ee8d63a-kube-api-access-2vtrt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.543628 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.543547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:44.632444 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.632413    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"]
Jul 09 04:39:44.636224 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.636203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.643672 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.643590    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"]
Jul 09 04:39:44.680922 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.680892    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"]
Jul 09 04:39:44.683870 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:39:44.683843    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496fb746_9237_41c9_8d4d_4bff5ee8d63a.slice/crio-6930149119fc9da2a2372befa9457b7716c3807ce61c2f647414fcda25370269 WatchSource:0}: Error finding container 6930149119fc9da2a2372befa9457b7716c3807ce61c2f647414fcda25370269: Status 404 returned error can't find the container with id 6930149119fc9da2a2372befa9457b7716c3807ce61c2f647414fcda25370269
Jul 09 04:39:44.710817 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.710786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9" event={"ID":"496fb746-9237-41c9-8d4d-4bff5ee8d63a","Type":"ContainerStarted","Data":"6930149119fc9da2a2372befa9457b7716c3807ce61c2f647414fcda25370269"}
Jul 09 04:39:44.730924 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.730896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.731073 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.730932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.731073 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.731011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz745\" (UniqueName: \"kubernetes.io/projected/086e009e-0228-41f3-b615-9288907e5e23-kube-api-access-zz745\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.832038 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.831944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz745\" (UniqueName: \"kubernetes.io/projected/086e009e-0228-41f3-b615-9288907e5e23-kube-api-access-zz745\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.832038 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.832030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.832275 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.832061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.832535 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.832510    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.832728 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.832712    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.839738 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.839716    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz745\" (UniqueName: \"kubernetes.io/projected/086e009e-0228-41f3-b615-9288907e5e23-kube-api-access-zz745\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:44.947234 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:44.947199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:45.078532 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.078503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"]
Jul 09 04:39:45.080543 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:39:45.080515    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086e009e_0228_41f3_b615_9288907e5e23.slice/crio-5c8dd09cf42d5fe9fb077ea41290395de8ea7c17e98b2d2e169e03d6ee09848a WatchSource:0}: Error finding container 5c8dd09cf42d5fe9fb077ea41290395de8ea7c17e98b2d2e169e03d6ee09848a: Status 404 returned error can't find the container with id 5c8dd09cf42d5fe9fb077ea41290395de8ea7c17e98b2d2e169e03d6ee09848a
Jul 09 04:39:45.229216 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.229176    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"]
Jul 09 04:39:45.232729 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.232713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.241019 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.240991    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"]
Jul 09 04:39:45.337767 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.337671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z778d\" (UniqueName: \"kubernetes.io/projected/c30e37e4-b222-4106-acef-b654d94183f6-kube-api-access-z778d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.337767 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.337723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.337958 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.337790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.438385 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.438346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.438575 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.438397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z778d\" (UniqueName: \"kubernetes.io/projected/c30e37e4-b222-4106-acef-b654d94183f6-kube-api-access-z778d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.438575 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.438439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.438942 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.438919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.439020 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.438919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.446762 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.446721    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z778d\" (UniqueName: \"kubernetes.io/projected/c30e37e4-b222-4106-acef-b654d94183f6-kube-api-access-z778d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.560340 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.560304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:45.691686 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.691661    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"]
Jul 09 04:39:45.693933 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:39:45.693907    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30e37e4_b222_4106_acef_b654d94183f6.slice/crio-f832b3bf037ff1aaa6232a6f189523440c5ed2fe3036e3830f101f6e7749ae26 WatchSource:0}: Error finding container f832b3bf037ff1aaa6232a6f189523440c5ed2fe3036e3830f101f6e7749ae26: Status 404 returned error can't find the container with id f832b3bf037ff1aaa6232a6f189523440c5ed2fe3036e3830f101f6e7749ae26
Jul 09 04:39:45.716504 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.716400    2563 generic.go:356] "Generic (PLEG): container finished" podID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerID="fdbed00aa39e1913c601f95b8b716d514e108c4606e709d3f09a7885aff1902a" exitCode=0
Jul 09 04:39:45.716504 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.716468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9" event={"ID":"496fb746-9237-41c9-8d4d-4bff5ee8d63a","Type":"ContainerDied","Data":"fdbed00aa39e1913c601f95b8b716d514e108c4606e709d3f09a7885aff1902a"}
Jul 09 04:39:45.718094 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.718015    2563 generic.go:356] "Generic (PLEG): container finished" podID="086e009e-0228-41f3-b615-9288907e5e23" containerID="b6d3acbf3c9b9ab230d156b63d2cfc141cc5627d64de0f8fecfb4a29a8d5d95d" exitCode=0
Jul 09 04:39:45.718161 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.718096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz" event={"ID":"086e009e-0228-41f3-b615-9288907e5e23","Type":"ContainerDied","Data":"b6d3acbf3c9b9ab230d156b63d2cfc141cc5627d64de0f8fecfb4a29a8d5d95d"}
Jul 09 04:39:45.718161 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.718143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz" event={"ID":"086e009e-0228-41f3-b615-9288907e5e23","Type":"ContainerStarted","Data":"5c8dd09cf42d5fe9fb077ea41290395de8ea7c17e98b2d2e169e03d6ee09848a"}
Jul 09 04:39:45.719311 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.719289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65" event={"ID":"c30e37e4-b222-4106-acef-b654d94183f6","Type":"ContainerStarted","Data":"f832b3bf037ff1aaa6232a6f189523440c5ed2fe3036e3830f101f6e7749ae26"}
Jul 09 04:39:45.826496 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.826462    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"]
Jul 09 04:39:45.830121 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.830103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:45.837608 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.837579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"]
Jul 09 04:39:45.943043 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.943005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:45.943222 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.943057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:45.943222 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:45.943138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9x45\" (UniqueName: \"kubernetes.io/projected/e18f7959-55de-4dca-a727-1df7ec3fba24-kube-api-access-m9x45\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.043814 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.043772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.044000 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.043827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9x45\" (UniqueName: \"kubernetes.io/projected/e18f7959-55de-4dca-a727-1df7ec3fba24-kube-api-access-m9x45\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.044000 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.043870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.044152 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.044133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.044189 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.044162    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.052399 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.052373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9x45\" (UniqueName: \"kubernetes.io/projected/e18f7959-55de-4dca-a727-1df7ec3fba24-kube-api-access-m9x45\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.162808 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.162728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:46.312941 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.312917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"]
Jul 09 04:39:46.314692 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:39:46.314667    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18f7959_55de_4dca_a727_1df7ec3fba24.slice/crio-8f6d2a9f8c6417c1ff34660ab817bade5b6200960a0665feedec907387fc67d2 WatchSource:0}: Error finding container 8f6d2a9f8c6417c1ff34660ab817bade5b6200960a0665feedec907387fc67d2: Status 404 returned error can't find the container with id 8f6d2a9f8c6417c1ff34660ab817bade5b6200960a0665feedec907387fc67d2
Jul 09 04:39:46.728135 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.728100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz" event={"ID":"086e009e-0228-41f3-b615-9288907e5e23","Type":"ContainerStarted","Data":"698243af758d0fb5c77080f06ac3025af5a0aece4e6bcc30a4fb7c150e99049d"}
Jul 09 04:39:46.730024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.729985    2563 generic.go:356] "Generic (PLEG): container finished" podID="c30e37e4-b222-4106-acef-b654d94183f6" containerID="d4dde86fa112d484c8632d3768f489ed3c05c4e4ced8d31d4f4c969e6d6fe6d5" exitCode=0
Jul 09 04:39:46.730161 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.730068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65" event={"ID":"c30e37e4-b222-4106-acef-b654d94183f6","Type":"ContainerDied","Data":"d4dde86fa112d484c8632d3768f489ed3c05c4e4ced8d31d4f4c969e6d6fe6d5"}
Jul 09 04:39:46.731940 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.731919    2563 generic.go:356] "Generic (PLEG): container finished" podID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerID="05d255b506650dada048185db9da8fb317b83bd865b1bfa639eb2b80d32f5dec" exitCode=0
Jul 09 04:39:46.732041 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.732017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs" event={"ID":"e18f7959-55de-4dca-a727-1df7ec3fba24","Type":"ContainerDied","Data":"05d255b506650dada048185db9da8fb317b83bd865b1bfa639eb2b80d32f5dec"}
Jul 09 04:39:46.732142 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.732074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs" event={"ID":"e18f7959-55de-4dca-a727-1df7ec3fba24","Type":"ContainerStarted","Data":"8f6d2a9f8c6417c1ff34660ab817bade5b6200960a0665feedec907387fc67d2"}
Jul 09 04:39:46.734305 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:46.734240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9" event={"ID":"496fb746-9237-41c9-8d4d-4bff5ee8d63a","Type":"ContainerStarted","Data":"e2d3d9b02584ce7dfc9c3dceb59ace223dc6b473be5183bd09189eec0c54b430"}
Jul 09 04:39:47.741715 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:47.741673    2563 generic.go:356] "Generic (PLEG): container finished" podID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerID="e2d3d9b02584ce7dfc9c3dceb59ace223dc6b473be5183bd09189eec0c54b430" exitCode=0
Jul 09 04:39:47.742223 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:47.741747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9" event={"ID":"496fb746-9237-41c9-8d4d-4bff5ee8d63a","Type":"ContainerDied","Data":"e2d3d9b02584ce7dfc9c3dceb59ace223dc6b473be5183bd09189eec0c54b430"}
Jul 09 04:39:47.743853 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:47.743829    2563 generic.go:356] "Generic (PLEG): container finished" podID="086e009e-0228-41f3-b615-9288907e5e23" containerID="698243af758d0fb5c77080f06ac3025af5a0aece4e6bcc30a4fb7c150e99049d" exitCode=0
Jul 09 04:39:47.743955 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:47.743922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz" event={"ID":"086e009e-0228-41f3-b615-9288907e5e23","Type":"ContainerDied","Data":"698243af758d0fb5c77080f06ac3025af5a0aece4e6bcc30a4fb7c150e99049d"}
Jul 09 04:39:48.752629 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.752517    2563 generic.go:356] "Generic (PLEG): container finished" podID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerID="7c4e6a6e4744ca717b5ec721d84cad494a3207c99f48532abec6a5936af5479a" exitCode=0
Jul 09 04:39:48.752629 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.752612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs" event={"ID":"e18f7959-55de-4dca-a727-1df7ec3fba24","Type":"ContainerDied","Data":"7c4e6a6e4744ca717b5ec721d84cad494a3207c99f48532abec6a5936af5479a"}
Jul 09 04:39:48.755090 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.755064    2563 generic.go:356] "Generic (PLEG): container finished" podID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerID="f781fc57028abb208a43e2b84c82340a6e0a33f8bdbc4b091fc337c895eec000" exitCode=0
Jul 09 04:39:48.755198 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.755143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9" event={"ID":"496fb746-9237-41c9-8d4d-4bff5ee8d63a","Type":"ContainerDied","Data":"f781fc57028abb208a43e2b84c82340a6e0a33f8bdbc4b091fc337c895eec000"}
Jul 09 04:39:48.757208 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.757188    2563 generic.go:356] "Generic (PLEG): container finished" podID="086e009e-0228-41f3-b615-9288907e5e23" containerID="cdc2276ba2788c6f0010dd0293b18e654f32169239bfbe3f13f9f2d8ba7cf688" exitCode=0
Jul 09 04:39:48.757297 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.757260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz" event={"ID":"086e009e-0228-41f3-b615-9288907e5e23","Type":"ContainerDied","Data":"cdc2276ba2788c6f0010dd0293b18e654f32169239bfbe3f13f9f2d8ba7cf688"}
Jul 09 04:39:48.759166 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.759145    2563 generic.go:356] "Generic (PLEG): container finished" podID="c30e37e4-b222-4106-acef-b654d94183f6" containerID="f6466111c679dd04fd513e40f9cd5e558bace556ab06973d066e70e46f3f8533" exitCode=0
Jul 09 04:39:48.759249 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:48.759204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65" event={"ID":"c30e37e4-b222-4106-acef-b654d94183f6","Type":"ContainerDied","Data":"f6466111c679dd04fd513e40f9cd5e558bace556ab06973d066e70e46f3f8533"}
Jul 09 04:39:49.769942 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:49.769907    2563 generic.go:356] "Generic (PLEG): container finished" podID="c30e37e4-b222-4106-acef-b654d94183f6" containerID="ef53036e4e03b87709e42019e89044ad041a70b3ecc58b3cd249ec7ac8c3a8eb" exitCode=0
Jul 09 04:39:49.770346 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:49.769995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65" event={"ID":"c30e37e4-b222-4106-acef-b654d94183f6","Type":"ContainerDied","Data":"ef53036e4e03b87709e42019e89044ad041a70b3ecc58b3cd249ec7ac8c3a8eb"}
Jul 09 04:39:49.772142 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:49.772115    2563 generic.go:356] "Generic (PLEG): container finished" podID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerID="c07bc742f5aa84ccf7ff63512f9ea80b84febc0455dfdd99d762d533794a91c6" exitCode=0
Jul 09 04:39:49.772275 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:49.772186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs" event={"ID":"e18f7959-55de-4dca-a727-1df7ec3fba24","Type":"ContainerDied","Data":"c07bc742f5aa84ccf7ff63512f9ea80b84febc0455dfdd99d762d533794a91c6"}
Jul 09 04:39:49.931759 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:49.931727    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:49.934406 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:49.934389    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:50.080225 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080131    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-bundle\") pod \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") "
Jul 09 04:39:50.080393 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080258    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-bundle\") pod \"086e009e-0228-41f3-b615-9288907e5e23\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") "
Jul 09 04:39:50.080393 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080281    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vtrt\" (UniqueName: \"kubernetes.io/projected/496fb746-9237-41c9-8d4d-4bff5ee8d63a-kube-api-access-2vtrt\") pod \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") "
Jul 09 04:39:50.080393 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080309    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz745\" (UniqueName: \"kubernetes.io/projected/086e009e-0228-41f3-b615-9288907e5e23-kube-api-access-zz745\") pod \"086e009e-0228-41f3-b615-9288907e5e23\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") "
Jul 09 04:39:50.080393 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080328    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-util\") pod \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\" (UID: \"496fb746-9237-41c9-8d4d-4bff5ee8d63a\") "
Jul 09 04:39:50.080393 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080344    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-util\") pod \"086e009e-0228-41f3-b615-9288907e5e23\" (UID: \"086e009e-0228-41f3-b615-9288907e5e23\") "
Jul 09 04:39:50.080881 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080850    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-bundle" (OuterVolumeSpecName: "bundle") pod "496fb746-9237-41c9-8d4d-4bff5ee8d63a" (UID: "496fb746-9237-41c9-8d4d-4bff5ee8d63a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:50.080881 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.080860    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-bundle" (OuterVolumeSpecName: "bundle") pod "086e009e-0228-41f3-b615-9288907e5e23" (UID: "086e009e-0228-41f3-b615-9288907e5e23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:50.082605 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.082588    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496fb746-9237-41c9-8d4d-4bff5ee8d63a-kube-api-access-2vtrt" (OuterVolumeSpecName: "kube-api-access-2vtrt") pod "496fb746-9237-41c9-8d4d-4bff5ee8d63a" (UID: "496fb746-9237-41c9-8d4d-4bff5ee8d63a"). InnerVolumeSpecName "kube-api-access-2vtrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:39:50.082813 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.082793    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086e009e-0228-41f3-b615-9288907e5e23-kube-api-access-zz745" (OuterVolumeSpecName: "kube-api-access-zz745") pod "086e009e-0228-41f3-b615-9288907e5e23" (UID: "086e009e-0228-41f3-b615-9288907e5e23"). InnerVolumeSpecName "kube-api-access-zz745". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:39:50.086133 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.086097    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-util" (OuterVolumeSpecName: "util") pod "086e009e-0228-41f3-b615-9288907e5e23" (UID: "086e009e-0228-41f3-b615-9288907e5e23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:50.167161 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.167120    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-util" (OuterVolumeSpecName: "util") pod "496fb746-9237-41c9-8d4d-4bff5ee8d63a" (UID: "496fb746-9237-41c9-8d4d-4bff5ee8d63a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:50.181210 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.181185    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:50.181210 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.181210    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vtrt\" (UniqueName: \"kubernetes.io/projected/496fb746-9237-41c9-8d4d-4bff5ee8d63a-kube-api-access-2vtrt\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:50.181320 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.181222    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz745\" (UniqueName: \"kubernetes.io/projected/086e009e-0228-41f3-b615-9288907e5e23-kube-api-access-zz745\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:50.181320 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.181232    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-util\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:50.181320 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.181240    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086e009e-0228-41f3-b615-9288907e5e23-util\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:50.181320 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.181250    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496fb746-9237-41c9-8d4d-4bff5ee8d63a-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:50.779381 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.779345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9" event={"ID":"496fb746-9237-41c9-8d4d-4bff5ee8d63a","Type":"ContainerDied","Data":"6930149119fc9da2a2372befa9457b7716c3807ce61c2f647414fcda25370269"}
Jul 09 04:39:50.779808 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.779399    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6930149119fc9da2a2372befa9457b7716c3807ce61c2f647414fcda25370269"
Jul 09 04:39:50.779808 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.779359    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9"
Jul 09 04:39:50.781519 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.781488    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz"
Jul 09 04:39:50.781696 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.781623    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz" event={"ID":"086e009e-0228-41f3-b615-9288907e5e23","Type":"ContainerDied","Data":"5c8dd09cf42d5fe9fb077ea41290395de8ea7c17e98b2d2e169e03d6ee09848a"}
Jul 09 04:39:50.781696 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.781691    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c8dd09cf42d5fe9fb077ea41290395de8ea7c17e98b2d2e169e03d6ee09848a"
Jul 09 04:39:50.941291 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.941263    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:50.944631 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:50.944609    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:51.088582 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.088548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-util\") pod \"c30e37e4-b222-4106-acef-b654d94183f6\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") "
Jul 09 04:39:51.088582 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.088590    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z778d\" (UniqueName: \"kubernetes.io/projected/c30e37e4-b222-4106-acef-b654d94183f6-kube-api-access-z778d\") pod \"c30e37e4-b222-4106-acef-b654d94183f6\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") "
Jul 09 04:39:51.088843 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.088609    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-util\") pod \"e18f7959-55de-4dca-a727-1df7ec3fba24\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") "
Jul 09 04:39:51.088843 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.088672    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-bundle\") pod \"e18f7959-55de-4dca-a727-1df7ec3fba24\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") "
Jul 09 04:39:51.088843 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.088721    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9x45\" (UniqueName: \"kubernetes.io/projected/e18f7959-55de-4dca-a727-1df7ec3fba24-kube-api-access-m9x45\") pod \"e18f7959-55de-4dca-a727-1df7ec3fba24\" (UID: \"e18f7959-55de-4dca-a727-1df7ec3fba24\") "
Jul 09 04:39:51.088843 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.088748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-bundle\") pod \"c30e37e4-b222-4106-acef-b654d94183f6\" (UID: \"c30e37e4-b222-4106-acef-b654d94183f6\") "
Jul 09 04:39:51.089208 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.089177    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-bundle" (OuterVolumeSpecName: "bundle") pod "e18f7959-55de-4dca-a727-1df7ec3fba24" (UID: "e18f7959-55de-4dca-a727-1df7ec3fba24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:51.089400 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.089377    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-bundle" (OuterVolumeSpecName: "bundle") pod "c30e37e4-b222-4106-acef-b654d94183f6" (UID: "c30e37e4-b222-4106-acef-b654d94183f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:51.090850 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.090824    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c30e37e4-b222-4106-acef-b654d94183f6-kube-api-access-z778d" (OuterVolumeSpecName: "kube-api-access-z778d") pod "c30e37e4-b222-4106-acef-b654d94183f6" (UID: "c30e37e4-b222-4106-acef-b654d94183f6"). InnerVolumeSpecName "kube-api-access-z778d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:39:51.090984 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.090963    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18f7959-55de-4dca-a727-1df7ec3fba24-kube-api-access-m9x45" (OuterVolumeSpecName: "kube-api-access-m9x45") pod "e18f7959-55de-4dca-a727-1df7ec3fba24" (UID: "e18f7959-55de-4dca-a727-1df7ec3fba24"). InnerVolumeSpecName "kube-api-access-m9x45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:39:51.094012 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.093959    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-util" (OuterVolumeSpecName: "util") pod "e18f7959-55de-4dca-a727-1df7ec3fba24" (UID: "e18f7959-55de-4dca-a727-1df7ec3fba24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:51.189735 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.189689    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-util" (OuterVolumeSpecName: "util") pod "c30e37e4-b222-4106-acef-b654d94183f6" (UID: "c30e37e4-b222-4106-acef-b654d94183f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:39:51.189735 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.189716    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z778d\" (UniqueName: \"kubernetes.io/projected/c30e37e4-b222-4106-acef-b654d94183f6-kube-api-access-z778d\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:51.189735 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.189738    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-util\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:51.189956 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.189750    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e18f7959-55de-4dca-a727-1df7ec3fba24-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:51.189956 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.189758    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9x45\" (UniqueName: \"kubernetes.io/projected/e18f7959-55de-4dca-a727-1df7ec3fba24-kube-api-access-m9x45\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:51.189956 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.189767    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-bundle\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:51.291000 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.290972    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c30e37e4-b222-4106-acef-b654d94183f6-util\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:39:51.787534 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.787498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs" event={"ID":"e18f7959-55de-4dca-a727-1df7ec3fba24","Type":"ContainerDied","Data":"8f6d2a9f8c6417c1ff34660ab817bade5b6200960a0665feedec907387fc67d2"}
Jul 09 04:39:51.787963 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.787553    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f6d2a9f8c6417c1ff34660ab817bade5b6200960a0665feedec907387fc67d2"
Jul 09 04:39:51.787963 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.787514    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs"
Jul 09 04:39:51.789404 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.789380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65" event={"ID":"c30e37e4-b222-4106-acef-b654d94183f6","Type":"ContainerDied","Data":"f832b3bf037ff1aaa6232a6f189523440c5ed2fe3036e3830f101f6e7749ae26"}
Jul 09 04:39:51.789509 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.789415    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65"
Jul 09 04:39:51.789509 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:39:51.789423    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f832b3bf037ff1aaa6232a6f189523440c5ed2fe3036e3830f101f6e7749ae26"
Jul 09 04:40:34.160484 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.160448    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"]
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.160951    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086e009e-0228-41f3-b615-9288907e5e23" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.160968    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="086e009e-0228-41f3-b615-9288907e5e23" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.160980    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c30e37e4-b222-4106-acef-b654d94183f6" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.160988    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c30e37e4-b222-4106-acef-b654d94183f6" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161000    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161009    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161017    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerName="pull"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161025    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerName="pull"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161036    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerName="extract"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161045    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerName="extract"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161061    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerName="pull"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161070    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerName="pull"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161089    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161098    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerName="util"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161107    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerName="extract"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161125    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerName="extract"
Jul 09 04:40:34.161125 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161136    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c30e37e4-b222-4106-acef-b654d94183f6" containerName="extract"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161143    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c30e37e4-b222-4106-acef-b654d94183f6" containerName="extract"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161154    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086e009e-0228-41f3-b615-9288907e5e23" containerName="pull"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161161    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="086e009e-0228-41f3-b615-9288907e5e23" containerName="pull"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161170    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086e009e-0228-41f3-b615-9288907e5e23" containerName="extract"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161178    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="086e009e-0228-41f3-b615-9288907e5e23" containerName="extract"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161187    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c30e37e4-b222-4106-acef-b654d94183f6" containerName="pull"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161194    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c30e37e4-b222-4106-acef-b654d94183f6" containerName="pull"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161283    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="086e009e-0228-41f3-b615-9288907e5e23" containerName="extract"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161292    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18f7959-55de-4dca-a727-1df7ec3fba24" containerName="extract"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161302    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c30e37e4-b222-4106-acef-b654d94183f6" containerName="extract"
Jul 09 04:40:34.162024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.161312    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="496fb746-9237-41c9-8d4d-4bff5ee8d63a" containerName="extract"
Jul 09 04:40:34.166325 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.166303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.169109 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.169079    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 04:40:34.169109 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.169107    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kp4rx\""
Jul 09 04:40:34.169262 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.169087    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 04:40:34.178040 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.178015    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"]
Jul 09 04:40:34.264608 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.264568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16062fd0-92a3-4820-8dc7-bb15b91362b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.264833 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.264625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shvq5\" (UniqueName: \"kubernetes.io/projected/16062fd0-92a3-4820-8dc7-bb15b91362b1-kube-api-access-shvq5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.365957 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.365921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16062fd0-92a3-4820-8dc7-bb15b91362b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.366134 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.365983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shvq5\" (UniqueName: \"kubernetes.io/projected/16062fd0-92a3-4820-8dc7-bb15b91362b1-kube-api-access-shvq5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.366317 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.366298    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16062fd0-92a3-4820-8dc7-bb15b91362b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.373751 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.373730    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shvq5\" (UniqueName: \"kubernetes.io/projected/16062fd0-92a3-4820-8dc7-bb15b91362b1-kube-api-access-shvq5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.477010 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.476979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:34.611179 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.611151    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"]
Jul 09 04:40:34.613235 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:40:34.613206    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16062fd0_92a3_4820_8dc7_bb15b91362b1.slice/crio-847cb0578186939a25d9a9537fd5ef4a566abbc7e623b8383afde8462f7a72d5 WatchSource:0}: Error finding container 847cb0578186939a25d9a9537fd5ef4a566abbc7e623b8383afde8462f7a72d5: Status 404 returned error can't find the container with id 847cb0578186939a25d9a9537fd5ef4a566abbc7e623b8383afde8462f7a72d5
Jul 09 04:40:34.913533 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.913431    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"]
Jul 09 04:40:34.916147 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.916118    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"]
Jul 09 04:40:34.965035 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.964994    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"]
Jul 09 04:40:34.970380 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.970340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:34.997485 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:34.997451    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"]
Jul 09 04:40:35.071377 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.071341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp622\" (UniqueName: \"kubernetes.io/projected/9f676230-13a4-404b-876c-6d4778de11af-kube-api-access-wp622\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j45kq\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:35.071377 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.071383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f676230-13a4-404b-876c-6d4778de11af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j45kq\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:35.172180 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.172095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f676230-13a4-404b-876c-6d4778de11af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j45kq\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:35.172600 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.172224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp622\" (UniqueName: \"kubernetes.io/projected/9f676230-13a4-404b-876c-6d4778de11af-kube-api-access-wp622\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j45kq\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:35.172600 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.172407    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f676230-13a4-404b-876c-6d4778de11af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j45kq\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:35.182849 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.182821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp622\" (UniqueName: \"kubernetes.io/projected/9f676230-13a4-404b-876c-6d4778de11af-kube-api-access-wp622\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j45kq\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:35.281393 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.281357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:35.697326 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:35.697298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"]
Jul 09 04:40:35.784125 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:40:35.784091    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f676230_13a4_404b_876c_6d4778de11af.slice/crio-7f5bcefbdc3992edc58e917db3e5fd7886627e99288504f7eeca137c8abcbeb8 WatchSource:0}: Error finding container 7f5bcefbdc3992edc58e917db3e5fd7886627e99288504f7eeca137c8abcbeb8: Status 404 returned error can't find the container with id 7f5bcefbdc3992edc58e917db3e5fd7886627e99288504f7eeca137c8abcbeb8
Jul 09 04:40:36.009471 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:36.009432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq" event={"ID":"9f676230-13a4-404b-876c-6d4778de11af","Type":"ContainerStarted","Data":"7f5bcefbdc3992edc58e917db3e5fd7886627e99288504f7eeca137c8abcbeb8"}
Jul 09 04:40:40.034693 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.034610    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw" podUID="16062fd0-92a3-4820-8dc7-bb15b91362b1" containerName="manager" containerID="cri-o://a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18" gracePeriod=2
Jul 09 04:40:40.036433 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.036397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq" event={"ID":"9f676230-13a4-404b-876c-6d4778de11af","Type":"ContainerStarted","Data":"73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0"}
Jul 09 04:40:40.036567 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.036468    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:40.056896 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.056847    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq" podStartSLOduration=2.242829559 podStartE2EDuration="6.056830502s" totalImagesPullingTime="3.814000943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:40:40.054706119 +0000 UTC m=+507.215126652" watchObservedRunningTime="2026-07-09 04:40:40.056830502 +0000 UTC m=+507.217251393"
Jul 09 04:40:40.275334 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.275303    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:40.277731 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:40:40.277699    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" is forbidden: User \"system:node:ip-10-0-134-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-202.ec2.internal' and this object" podUID="16062fd0-92a3-4820-8dc7-bb15b91362b1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:40.420955 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.420866    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shvq5\" (UniqueName: \"kubernetes.io/projected/16062fd0-92a3-4820-8dc7-bb15b91362b1-kube-api-access-shvq5\") pod \"16062fd0-92a3-4820-8dc7-bb15b91362b1\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") "
Jul 09 04:40:40.421153 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.421012    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16062fd0-92a3-4820-8dc7-bb15b91362b1-extensions-socket-volume\") pod \"16062fd0-92a3-4820-8dc7-bb15b91362b1\" (UID: \"16062fd0-92a3-4820-8dc7-bb15b91362b1\") "
Jul 09 04:40:40.421153 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.421143    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16062fd0-92a3-4820-8dc7-bb15b91362b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "16062fd0-92a3-4820-8dc7-bb15b91362b1" (UID: "16062fd0-92a3-4820-8dc7-bb15b91362b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:40:40.421282 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.421270    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16062fd0-92a3-4820-8dc7-bb15b91362b1-extensions-socket-volume\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:40:40.423038 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.423016    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16062fd0-92a3-4820-8dc7-bb15b91362b1-kube-api-access-shvq5" (OuterVolumeSpecName: "kube-api-access-shvq5") pod "16062fd0-92a3-4820-8dc7-bb15b91362b1" (UID: "16062fd0-92a3-4820-8dc7-bb15b91362b1"). InnerVolumeSpecName "kube-api-access-shvq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:40:40.521965 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.521929    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shvq5\" (UniqueName: \"kubernetes.io/projected/16062fd0-92a3-4820-8dc7-bb15b91362b1-kube-api-access-shvq5\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:40:40.701287 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:40.701209    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16062fd0-92a3-4820-8dc7-bb15b91362b1" path="/var/lib/kubelet/pods/16062fd0-92a3-4820-8dc7-bb15b91362b1/volumes"
Jul 09 04:40:41.042699 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:41.042635    2563 generic.go:356] "Generic (PLEG): container finished" podID="16062fd0-92a3-4820-8dc7-bb15b91362b1" containerID="a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18" exitCode=2
Jul 09 04:40:41.042699 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:41.042698    2563 scope.go:117] "RemoveContainer" containerID="a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18"
Jul 09 04:40:41.043221 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:41.042699    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:41.048203 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:40:41.048180    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-7t2dw\" is forbidden: User \"system:node:ip-10-0-134-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-202.ec2.internal' and this object" podUID="16062fd0-92a3-4820-8dc7-bb15b91362b1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7t2dw"
Jul 09 04:40:41.051406 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:41.051390    2563 scope.go:117] "RemoveContainer" containerID="a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18"
Jul 09 04:40:41.051698 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:40:41.051675    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18\": container with ID starting with a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18 not found: ID does not exist" containerID="a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18"
Jul 09 04:40:41.051756 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:41.051709    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18"} err="failed to get container status \"a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18\": rpc error: code = NotFound desc = could not find container \"a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18\": container with ID starting with a4446680dc207c8139ea98565a745f218628fc0a85f32ab10949340d188f5a18 not found: ID does not exist"
Jul 09 04:40:51.045238 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.045207    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:40:51.282585 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.282542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"]
Jul 09 04:40:51.282939 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.282926    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16062fd0-92a3-4820-8dc7-bb15b91362b1" containerName="manager"
Jul 09 04:40:51.282981 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.282941    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="16062fd0-92a3-4820-8dc7-bb15b91362b1" containerName="manager"
Jul 09 04:40:51.283014 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.283009    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="16062fd0-92a3-4820-8dc7-bb15b91362b1" containerName="manager"
Jul 09 04:40:51.287439 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.287422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.299904 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.299849    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"]
Jul 09 04:40:51.317409 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.317373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjwbd\" (UniqueName: \"kubernetes.io/projected/860cc4e3-77ee-45a4-93c0-c19746574413-kube-api-access-sjwbd\") pod \"kuadrant-operator-controller-manager-86878c769f-n7mdv\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.317587 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.317424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/860cc4e3-77ee-45a4-93c0-c19746574413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n7mdv\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.418089 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.418053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/860cc4e3-77ee-45a4-93c0-c19746574413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n7mdv\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.418260 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.418125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjwbd\" (UniqueName: \"kubernetes.io/projected/860cc4e3-77ee-45a4-93c0-c19746574413-kube-api-access-sjwbd\") pod \"kuadrant-operator-controller-manager-86878c769f-n7mdv\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.418460 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.418441    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/860cc4e3-77ee-45a4-93c0-c19746574413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n7mdv\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.434274 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.434237    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjwbd\" (UniqueName: \"kubernetes.io/projected/860cc4e3-77ee-45a4-93c0-c19746574413-kube-api-access-sjwbd\") pod \"kuadrant-operator-controller-manager-86878c769f-n7mdv\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.597326 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.597240    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:51.735560 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:51.735537    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"]
Jul 09 04:40:51.737751 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:40:51.737724    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860cc4e3_77ee_45a4_93c0_c19746574413.slice/crio-2a78c5f2d097f6992f9e46a879bed36445411895a5b09ea8e4467976da9343b3 WatchSource:0}: Error finding container 2a78c5f2d097f6992f9e46a879bed36445411895a5b09ea8e4467976da9343b3: Status 404 returned error can't find the container with id 2a78c5f2d097f6992f9e46a879bed36445411895a5b09ea8e4467976da9343b3
Jul 09 04:40:52.103870 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:52.103836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv" event={"ID":"860cc4e3-77ee-45a4-93c0-c19746574413","Type":"ContainerStarted","Data":"699ddf2f88dc5e717729e1d7c5505a9b038202dcce32ad9a1da3d314af2192cf"}
Jul 09 04:40:52.104302 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:52.103884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv" event={"ID":"860cc4e3-77ee-45a4-93c0-c19746574413","Type":"ContainerStarted","Data":"2a78c5f2d097f6992f9e46a879bed36445411895a5b09ea8e4467976da9343b3"}
Jul 09 04:40:52.104302 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:52.103947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:40:52.124737 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:40:52.124680    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv" podStartSLOduration=1.124635924 podStartE2EDuration="1.124635924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:40:52.12331924 +0000 UTC m=+519.283739772" watchObservedRunningTime="2026-07-09 04:40:52.124635924 +0000 UTC m=+519.285056443"
Jul 09 04:41:03.111069 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.111036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:41:03.157050 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.157009    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"]
Jul 09 04:41:03.157371 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.157322    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq" podUID="9f676230-13a4-404b-876c-6d4778de11af" containerName="manager" containerID="cri-o://73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0" gracePeriod=10
Jul 09 04:41:03.423208 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.423180    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:41:03.506463 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.506425    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp622\" (UniqueName: \"kubernetes.io/projected/9f676230-13a4-404b-876c-6d4778de11af-kube-api-access-wp622\") pod \"9f676230-13a4-404b-876c-6d4778de11af\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") "
Jul 09 04:41:03.506686 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.506475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f676230-13a4-404b-876c-6d4778de11af-extensions-socket-volume\") pod \"9f676230-13a4-404b-876c-6d4778de11af\" (UID: \"9f676230-13a4-404b-876c-6d4778de11af\") "
Jul 09 04:41:03.507005 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.506982    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f676230-13a4-404b-876c-6d4778de11af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f676230-13a4-404b-876c-6d4778de11af" (UID: "9f676230-13a4-404b-876c-6d4778de11af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:41:03.508705 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.508675    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f676230-13a4-404b-876c-6d4778de11af-kube-api-access-wp622" (OuterVolumeSpecName: "kube-api-access-wp622") pod "9f676230-13a4-404b-876c-6d4778de11af" (UID: "9f676230-13a4-404b-876c-6d4778de11af"). InnerVolumeSpecName "kube-api-access-wp622". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:41:03.607183 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.607145    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp622\" (UniqueName: \"kubernetes.io/projected/9f676230-13a4-404b-876c-6d4778de11af-kube-api-access-wp622\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:41:03.607183 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:03.607175    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f676230-13a4-404b-876c-6d4778de11af-extensions-socket-volume\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:41:04.171402 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.171363    2563 generic.go:356] "Generic (PLEG): container finished" podID="9f676230-13a4-404b-876c-6d4778de11af" containerID="73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0" exitCode=0
Jul 09 04:41:04.171845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.171411    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"
Jul 09 04:41:04.171845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.171450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq" event={"ID":"9f676230-13a4-404b-876c-6d4778de11af","Type":"ContainerDied","Data":"73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0"}
Jul 09 04:41:04.171845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.171511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq" event={"ID":"9f676230-13a4-404b-876c-6d4778de11af","Type":"ContainerDied","Data":"7f5bcefbdc3992edc58e917db3e5fd7886627e99288504f7eeca137c8abcbeb8"}
Jul 09 04:41:04.171845 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.171532    2563 scope.go:117] "RemoveContainer" containerID="73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0"
Jul 09 04:41:04.181254 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.181234    2563 scope.go:117] "RemoveContainer" containerID="73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0"
Jul 09 04:41:04.181538 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:41:04.181514    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0\": container with ID starting with 73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0 not found: ID does not exist" containerID="73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0"
Jul 09 04:41:04.181612 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.181550    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0"} err="failed to get container status \"73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0\": rpc error: code = NotFound desc = could not find container \"73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0\": container with ID starting with 73780e9286cfad9ab0cf75e6aafb8703379cf4376fb5b4abf73100786cf760e0 not found: ID does not exist"
Jul 09 04:41:04.194880 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.194852    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"]
Jul 09 04:41:04.198688 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.198664    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j45kq"]
Jul 09 04:41:04.701939 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:41:04.701910    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f676230-13a4-404b-876c-6d4778de11af" path="/var/lib/kubelet/pods/9f676230-13a4-404b-876c-6d4778de11af/volumes"
Jul 09 04:42:13.200827 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:13.200797    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:42:13.202140 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:13.202122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:42:33.755035 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.754996    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"]
Jul 09 04:42:33.757404 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.755362    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f676230-13a4-404b-876c-6d4778de11af" containerName="manager"
Jul 09 04:42:33.757404 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.755374    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f676230-13a4-404b-876c-6d4778de11af" containerName="manager"
Jul 09 04:42:33.757404 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.755434    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f676230-13a4-404b-876c-6d4778de11af" containerName="manager"
Jul 09 04:42:33.758429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.758413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:33.762525 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.762499    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 04:42:33.762525 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.762520    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 04:42:33.762832 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.762809    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tck2x\""
Jul 09 04:42:33.764433 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.764418    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 04:42:33.776934 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.776904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"]
Jul 09 04:42:33.910019 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.909984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d83d82-7046-45a0-a9a9-7fca9755d73d-openshift-service-ca\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:33.910019 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.910022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d83d82-7046-45a0-a9a9-7fca9755d73d-maas-api-tls\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:33.910231 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:33.910045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s2lt\" (UniqueName: \"kubernetes.io/projected/21d83d82-7046-45a0-a9a9-7fca9755d73d-kube-api-access-4s2lt\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.011364 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.011290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d83d82-7046-45a0-a9a9-7fca9755d73d-openshift-service-ca\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.011364 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.011326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d83d82-7046-45a0-a9a9-7fca9755d73d-maas-api-tls\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.011364 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.011360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s2lt\" (UniqueName: \"kubernetes.io/projected/21d83d82-7046-45a0-a9a9-7fca9755d73d-kube-api-access-4s2lt\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.011949 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.011931    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d83d82-7046-45a0-a9a9-7fca9755d73d-openshift-service-ca\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.013836 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.013818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d83d82-7046-45a0-a9a9-7fca9755d73d-maas-api-tls\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.020114 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.020083    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s2lt\" (UniqueName: \"kubernetes.io/projected/21d83d82-7046-45a0-a9a9-7fca9755d73d-kube-api-access-4s2lt\") pod \"maas-api-6b958b9845-zw2vb\" (UID: \"21d83d82-7046-45a0-a9a9-7fca9755d73d\") " pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.069169 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.069138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:34.216873 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.216839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"]
Jul 09 04:42:34.219602 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:42:34.219576    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d83d82_7046_45a0_a9a9_7fca9755d73d.slice/crio-d14ee2396fe58fa20fc9603026909a865d27a6c1f2e3b229a979e3434bd9261d WatchSource:0}: Error finding container d14ee2396fe58fa20fc9603026909a865d27a6c1f2e3b229a979e3434bd9261d: Status 404 returned error can't find the container with id d14ee2396fe58fa20fc9603026909a865d27a6c1f2e3b229a979e3434bd9261d
Jul 09 04:42:34.221452 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.221433    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:42:34.637885 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:34.637852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb" event={"ID":"21d83d82-7046-45a0-a9a9-7fca9755d73d","Type":"ContainerStarted","Data":"d14ee2396fe58fa20fc9603026909a865d27a6c1f2e3b229a979e3434bd9261d"}
Jul 09 04:42:36.650402 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:36.650367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb" event={"ID":"21d83d82-7046-45a0-a9a9-7fca9755d73d","Type":"ContainerStarted","Data":"f6fec83c982c26bbfb01e7145a042961a02190a5f53280fc09f360291eb2fe1f"}
Jul 09 04:42:36.650851 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:36.650469    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:42:36.667971 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:36.667920    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb" podStartSLOduration=1.906606864 podStartE2EDuration="3.667902665s" totalImagesPullingTime="1.761295801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:42:36.666677719 +0000 UTC m=+623.827098240" watchObservedRunningTime="2026-07-09 04:42:36.667902665 +0000 UTC m=+623.828323185"
Jul 09 04:42:42.661736 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:42:42.661703    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b958b9845-zw2vb"
Jul 09 04:43:05.240273 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.240240    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"]
Jul 09 04:43:05.244614 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.244588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.247021 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.246999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9g9xn\""
Jul 09 04:43:05.247949 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.247922    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 04:43:05.248065 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.247976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 04:43:05.248065 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.247981    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 04:43:05.255580 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.255551    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"]
Jul 09 04:43:05.379047 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.379016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.379047 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.379052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.379262 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.379079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.379262 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.379156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86sc9\" (UniqueName: \"kubernetes.io/projected/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-kube-api-access-86sc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.379262 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.379181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.379262 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.379195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.480449 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.480414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.480449 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.480448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.480706 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.480500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.480706 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.480519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.480706 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.480535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.480706 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.480679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86sc9\" (UniqueName: \"kubernetes.io/projected/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-kube-api-access-86sc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.481051 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.481028    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.481223 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.481082    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.481303 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.481119    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.483069 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.483050    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.483352 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.483325    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.488272 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.488246    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86sc9\" (UniqueName: \"kubernetes.io/projected/5c557cca-4acb-4a5f-a4a2-93bcc51a647b-kube-api-access-86sc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fb9lm\" (UID: \"5c557cca-4acb-4a5f-a4a2-93bcc51a647b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.556134 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.556044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:05.694536 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.694507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"]
Jul 09 04:43:05.696040 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:43:05.696016    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c557cca_4acb_4a5f_a4a2_93bcc51a647b.slice/crio-0ccc51a4318b622496fd39d328f8e8c8bf4eae4576c86b1079b09dfeb54b63a2 WatchSource:0}: Error finding container 0ccc51a4318b622496fd39d328f8e8c8bf4eae4576c86b1079b09dfeb54b63a2: Status 404 returned error can't find the container with id 0ccc51a4318b622496fd39d328f8e8c8bf4eae4576c86b1079b09dfeb54b63a2
Jul 09 04:43:05.806055 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:05.806016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm" event={"ID":"5c557cca-4acb-4a5f-a4a2-93bcc51a647b","Type":"ContainerStarted","Data":"0ccc51a4318b622496fd39d328f8e8c8bf4eae4576c86b1079b09dfeb54b63a2"}
Jul 09 04:43:06.813758 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:06.813718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm" event={"ID":"5c557cca-4acb-4a5f-a4a2-93bcc51a647b","Type":"ContainerStarted","Data":"e4f467160b953a93fdd83e6f573a70dc4f2850a190384fe817211cfbf4149124"}
Jul 09 04:43:06.829581 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:06.829515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm" podStartSLOduration=0.827871574 podStartE2EDuration="1.829495429s" totalImagesPullingTime="1.001623855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:43:06.829120515 +0000 UTC m=+653.989541037" watchObservedRunningTime="2026-07-09 04:43:06.829495429 +0000 UTC m=+653.989915949"
Jul 09 04:43:15.556976 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:15.556936    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:15.557457 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:15.557001    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:15.569544 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:15.569515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:43:15.876682 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:43:15.876573    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fb9lm"
Jul 09 04:45:00.141262 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.141223    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"]
Jul 09 04:45:00.144881 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.144863    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"
Jul 09 04:45:00.150843 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.150811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"]
Jul 09 04:45:00.261530 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.261482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrf6q\" (UniqueName: \"kubernetes.io/projected/1a956732-053e-4075-9550-9dd1af1f7475-kube-api-access-mrf6q\") pod \"maas-api-key-cleanup-29726205-p5gwn\" (UID: \"1a956732-053e-4075-9550-9dd1af1f7475\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"
Jul 09 04:45:00.362862 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.362826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrf6q\" (UniqueName: \"kubernetes.io/projected/1a956732-053e-4075-9550-9dd1af1f7475-kube-api-access-mrf6q\") pod \"maas-api-key-cleanup-29726205-p5gwn\" (UID: \"1a956732-053e-4075-9550-9dd1af1f7475\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"
Jul 09 04:45:00.370653 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.370617    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrf6q\" (UniqueName: \"kubernetes.io/projected/1a956732-053e-4075-9550-9dd1af1f7475-kube-api-access-mrf6q\") pod \"maas-api-key-cleanup-29726205-p5gwn\" (UID: \"1a956732-053e-4075-9550-9dd1af1f7475\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"
Jul 09 04:45:00.456129 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.456046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"
Jul 09 04:45:00.594347 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:00.594314    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"]
Jul 09 04:45:00.597624 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:45:00.597595    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a956732_053e_4075_9550_9dd1af1f7475.slice/crio-5c174324238dbcb618ca0e598fdaaf0061259b8e605ef51c38957efd1953b73e WatchSource:0}: Error finding container 5c174324238dbcb618ca0e598fdaaf0061259b8e605ef51c38957efd1953b73e: Status 404 returned error can't find the container with id 5c174324238dbcb618ca0e598fdaaf0061259b8e605ef51c38957efd1953b73e
Jul 09 04:45:01.389190 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:01.389159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn" event={"ID":"1a956732-053e-4075-9550-9dd1af1f7475","Type":"ContainerStarted","Data":"5c174324238dbcb618ca0e598fdaaf0061259b8e605ef51c38957efd1953b73e"}
Jul 09 04:45:03.402764 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:03.402706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn" event={"ID":"1a956732-053e-4075-9550-9dd1af1f7475","Type":"ContainerStarted","Data":"0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b"}
Jul 09 04:45:03.416886 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:45:03.416841    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn" podStartSLOduration=1.234674973 podStartE2EDuration="3.41682493s" totalImagesPullingTime="2.182149957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:45:03.41597483 +0000 UTC m=+770.576395362" watchObservedRunningTime="2026-07-09 04:45:03.41682493 +0000 UTC m=+770.577245449"
Jul 09 04:46:00.010209 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:00.010171    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"]
Jul 09 04:46:00.010709 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:00.010377    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn" podUID="1a956732-053e-4075-9550-9dd1af1f7475" containerName="cleanup" containerID="cri-o://0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b" gracePeriod=30
Jul 09 04:46:30.182892 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.182862    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"
Jul 09 04:46:30.267535 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.267437    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrf6q\" (UniqueName: \"kubernetes.io/projected/1a956732-053e-4075-9550-9dd1af1f7475-kube-api-access-mrf6q\") pod \"1a956732-053e-4075-9550-9dd1af1f7475\" (UID: \"1a956732-053e-4075-9550-9dd1af1f7475\") "
Jul 09 04:46:30.269904 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.269866    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a956732-053e-4075-9550-9dd1af1f7475-kube-api-access-mrf6q" (OuterVolumeSpecName: "kube-api-access-mrf6q") pod "1a956732-053e-4075-9550-9dd1af1f7475" (UID: "1a956732-053e-4075-9550-9dd1af1f7475"). InnerVolumeSpecName "kube-api-access-mrf6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:46:30.368655 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.368605    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrf6q\" (UniqueName: \"kubernetes.io/projected/1a956732-053e-4075-9550-9dd1af1f7475-kube-api-access-mrf6q\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:46:30.851869 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.851825    2563 generic.go:356] "Generic (PLEG): container finished" podID="1a956732-053e-4075-9550-9dd1af1f7475" containerID="0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b" exitCode=137
Jul 09 04:46:30.852057 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.851888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"
Jul 09 04:46:30.852057 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.851911    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn" event={"ID":"1a956732-053e-4075-9550-9dd1af1f7475","Type":"ContainerDied","Data":"0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b"}
Jul 09 04:46:30.852057 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.851970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn" event={"ID":"1a956732-053e-4075-9550-9dd1af1f7475","Type":"ContainerDied","Data":"5c174324238dbcb618ca0e598fdaaf0061259b8e605ef51c38957efd1953b73e"}
Jul 09 04:46:30.852057 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.851994    2563 scope.go:117] "RemoveContainer" containerID="0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b"
Jul 09 04:46:30.860783 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.860757    2563 scope.go:117] "RemoveContainer" containerID="0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b"
Jul 09 04:46:30.861098 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:46:30.861079    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b\": container with ID starting with 0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b not found: ID does not exist" containerID="0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b"
Jul 09 04:46:30.861150 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.861109    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b"} err="failed to get container status \"0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b\": rpc error: code = NotFound desc = could not find container \"0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b\": container with ID starting with 0975e78c477a9de60559f726ed4c456cfa250a0543fe333c3c61c5c91453b87b not found: ID does not exist"
Jul 09 04:46:30.868793 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.868768    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"]
Jul 09 04:46:30.872347 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:30.872322    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726205-p5gwn"]
Jul 09 04:46:32.701659 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:46:32.701613    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a956732-053e-4075-9550-9dd1af1f7475" path="/var/lib/kubelet/pods/1a956732-053e-4075-9550-9dd1af1f7475/volumes"
Jul 09 04:47:13.234199 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:47:13.234172    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:47:13.237660 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:47:13.237611    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:48:02.336930 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:48:02.336895    2563 generic.go:356] "Generic (PLEG): container finished" podID="93053eac-31a5-4383-8f9e-565627f4e01a" containerID="b00140221a55ff794d27219d22c8ffb8f22a168e852423be6d8d660731803eee" exitCode=1
Jul 09 04:48:02.337459 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:48:02.336956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf" event={"ID":"93053eac-31a5-4383-8f9e-565627f4e01a","Type":"ContainerDied","Data":"b00140221a55ff794d27219d22c8ffb8f22a168e852423be6d8d660731803eee"}
Jul 09 04:48:02.337459 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:48:02.337415    2563 scope.go:117] "RemoveContainer" containerID="b00140221a55ff794d27219d22c8ffb8f22a168e852423be6d8d660731803eee"
Jul 09 04:48:02.337791 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:48:02.337773    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:48:03.344890 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:48:03.344853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf" event={"ID":"93053eac-31a5-4383-8f9e-565627f4e01a","Type":"ContainerStarted","Data":"e30272aee316d5d1a0c075a8dc000454d170e7f54ed84511b8c93278e74a8254"}
Jul 09 04:48:03.345369 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:48:03.345213    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:48:14.352491 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:48:14.352452    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-cqmwf"
Jul 09 04:50:47.389187 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:47.389149    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"]
Jul 09 04:50:47.389785 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:47.389370    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv" podUID="860cc4e3-77ee-45a4-93c0-c19746574413" containerName="manager" containerID="cri-o://699ddf2f88dc5e717729e1d7c5505a9b038202dcce32ad9a1da3d314af2192cf" gracePeriod=10
Jul 09 04:50:50.214034 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.214001    2563 generic.go:356] "Generic (PLEG): container finished" podID="860cc4e3-77ee-45a4-93c0-c19746574413" containerID="699ddf2f88dc5e717729e1d7c5505a9b038202dcce32ad9a1da3d314af2192cf" exitCode=0
Jul 09 04:50:50.214429 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.214084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv" event={"ID":"860cc4e3-77ee-45a4-93c0-c19746574413","Type":"ContainerDied","Data":"699ddf2f88dc5e717729e1d7c5505a9b038202dcce32ad9a1da3d314af2192cf"}
Jul 09 04:50:50.241500 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.241474    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:50:50.357561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.357464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/860cc4e3-77ee-45a4-93c0-c19746574413-extensions-socket-volume\") pod \"860cc4e3-77ee-45a4-93c0-c19746574413\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") "
Jul 09 04:50:50.357561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.357547    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjwbd\" (UniqueName: \"kubernetes.io/projected/860cc4e3-77ee-45a4-93c0-c19746574413-kube-api-access-sjwbd\") pod \"860cc4e3-77ee-45a4-93c0-c19746574413\" (UID: \"860cc4e3-77ee-45a4-93c0-c19746574413\") "
Jul 09 04:50:50.357965 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.357939    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/860cc4e3-77ee-45a4-93c0-c19746574413-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "860cc4e3-77ee-45a4-93c0-c19746574413" (UID: "860cc4e3-77ee-45a4-93c0-c19746574413"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:50:50.359594 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.359574    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860cc4e3-77ee-45a4-93c0-c19746574413-kube-api-access-sjwbd" (OuterVolumeSpecName: "kube-api-access-sjwbd") pod "860cc4e3-77ee-45a4-93c0-c19746574413" (UID: "860cc4e3-77ee-45a4-93c0-c19746574413"). InnerVolumeSpecName "kube-api-access-sjwbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:50:50.458173 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.458135    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/860cc4e3-77ee-45a4-93c0-c19746574413-extensions-socket-volume\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:50:50.458173 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:50.458170    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjwbd\" (UniqueName: \"kubernetes.io/projected/860cc4e3-77ee-45a4-93c0-c19746574413-kube-api-access-sjwbd\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:50:51.221063 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:51.221023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv" event={"ID":"860cc4e3-77ee-45a4-93c0-c19746574413","Type":"ContainerDied","Data":"2a78c5f2d097f6992f9e46a879bed36445411895a5b09ea8e4467976da9343b3"}
Jul 09 04:50:51.221063 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:51.221056    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"
Jul 09 04:50:51.221565 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:51.221093    2563 scope.go:117] "RemoveContainer" containerID="699ddf2f88dc5e717729e1d7c5505a9b038202dcce32ad9a1da3d314af2192cf"
Jul 09 04:50:51.238441 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:51.238411    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"]
Jul 09 04:50:51.243984 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:51.243955    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n7mdv"]
Jul 09 04:50:52.700965 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:50:52.700932    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="860cc4e3-77ee-45a4-93c0-c19746574413" path="/var/lib/kubelet/pods/860cc4e3-77ee-45a4-93c0-c19746574413/volumes"
Jul 09 04:51:48.459930 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.459845    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"]
Jul 09 04:51:48.460398 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.460198    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a956732-053e-4075-9550-9dd1af1f7475" containerName="cleanup"
Jul 09 04:51:48.460398 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.460209    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a956732-053e-4075-9550-9dd1af1f7475" containerName="cleanup"
Jul 09 04:51:48.460398 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.460235    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="860cc4e3-77ee-45a4-93c0-c19746574413" containerName="manager"
Jul 09 04:51:48.460398 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.460241    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="860cc4e3-77ee-45a4-93c0-c19746574413" containerName="manager"
Jul 09 04:51:48.460398 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.460291    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="860cc4e3-77ee-45a4-93c0-c19746574413" containerName="manager"
Jul 09 04:51:48.460398 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.460301    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a956732-053e-4075-9550-9dd1af1f7475" containerName="cleanup"
Jul 09 04:51:48.462928 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.462912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.465578 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.465552    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 04:51:48.465578 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.465552    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kp4rx\""
Jul 09 04:51:48.465808 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.465562    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 04:51:48.478435 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.478411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"]
Jul 09 04:51:48.561309 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.561266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16343375-8c73-4daf-8341-e5562a333757-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qmkm9\" (UID: \"16343375-8c73-4daf-8341-e5562a333757\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.561491 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.561398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p568\" (UniqueName: \"kubernetes.io/projected/16343375-8c73-4daf-8341-e5562a333757-kube-api-access-8p568\") pod \"kuadrant-operator-controller-manager-86878c769f-qmkm9\" (UID: \"16343375-8c73-4daf-8341-e5562a333757\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.662237 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.662199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p568\" (UniqueName: \"kubernetes.io/projected/16343375-8c73-4daf-8341-e5562a333757-kube-api-access-8p568\") pod \"kuadrant-operator-controller-manager-86878c769f-qmkm9\" (UID: \"16343375-8c73-4daf-8341-e5562a333757\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.662392 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.662254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16343375-8c73-4daf-8341-e5562a333757-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qmkm9\" (UID: \"16343375-8c73-4daf-8341-e5562a333757\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.662708 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.662686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16343375-8c73-4daf-8341-e5562a333757-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qmkm9\" (UID: \"16343375-8c73-4daf-8341-e5562a333757\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.673003 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.672977    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p568\" (UniqueName: \"kubernetes.io/projected/16343375-8c73-4daf-8341-e5562a333757-kube-api-access-8p568\") pod \"kuadrant-operator-controller-manager-86878c769f-qmkm9\" (UID: \"16343375-8c73-4daf-8341-e5562a333757\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.773028 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.772994    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:48.916006 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:48.915983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"]
Jul 09 04:51:48.918608 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:51:48.918580    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16343375_8c73_4daf_8341_e5562a333757.slice/crio-cf64beaa23d76afe16dfea62d20bd985424ab2de58c56d49aa1c58933e0f15c6 WatchSource:0}: Error finding container cf64beaa23d76afe16dfea62d20bd985424ab2de58c56d49aa1c58933e0f15c6: Status 404 returned error can't find the container with id cf64beaa23d76afe16dfea62d20bd985424ab2de58c56d49aa1c58933e0f15c6
Jul 09 04:51:49.523919 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:49.523886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9" event={"ID":"16343375-8c73-4daf-8341-e5562a333757","Type":"ContainerStarted","Data":"506f670ba5a1f6fe399737679ba17b065a5af619373714cebabfb27a63e81d49"}
Jul 09 04:51:49.524382 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:49.523933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9" event={"ID":"16343375-8c73-4daf-8341-e5562a333757","Type":"ContainerStarted","Data":"cf64beaa23d76afe16dfea62d20bd985424ab2de58c56d49aa1c58933e0f15c6"}
Jul 09 04:51:49.524382 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:49.523968    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:51:49.542017 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:51:49.541959    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9" podStartSLOduration=1.541943201 podStartE2EDuration="1.541943201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:51:49.539692668 +0000 UTC m=+1176.700113185" watchObservedRunningTime="2026-07-09 04:51:49.541943201 +0000 UTC m=+1176.702363720"
Jul 09 04:52:00.531264 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:52:00.531231    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmkm9"
Jul 09 04:52:13.266962 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:52:13.266932    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:52:13.274261 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:52:13.274229    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:57:13.308062 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:57:13.308033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:57:13.315387 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:57:13.315364    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 04:58:07.745698 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.745660    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"]
Jul 09 04:58:07.749529 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.749497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.752187 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.752153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-985e40e4-serving-cert\""
Jul 09 04:58:07.758658 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.758615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"]
Jul 09 04:58:07.872384 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.872351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f19c60-2986-4206-a0eb-6d0030328df1-maas-api-tls\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.872561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.872402    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f19c60-2986-4206-a0eb-6d0030328df1-openshift-service-ca\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.872561 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.872441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mx2\" (UniqueName: \"kubernetes.io/projected/c4f19c60-2986-4206-a0eb-6d0030328df1-kube-api-access-82mx2\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.973765 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.973721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f19c60-2986-4206-a0eb-6d0030328df1-maas-api-tls\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.973956 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.973781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f19c60-2986-4206-a0eb-6d0030328df1-openshift-service-ca\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.973956 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.973826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mx2\" (UniqueName: \"kubernetes.io/projected/c4f19c60-2986-4206-a0eb-6d0030328df1-kube-api-access-82mx2\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.974488 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.974459    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f19c60-2986-4206-a0eb-6d0030328df1-openshift-service-ca\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.976303 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.976279    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f19c60-2986-4206-a0eb-6d0030328df1-maas-api-tls\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:07.981589 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:07.981565    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mx2\" (UniqueName: \"kubernetes.io/projected/c4f19c60-2986-4206-a0eb-6d0030328df1-kube-api-access-82mx2\") pod \"maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:08.063214 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:08.063127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:08.221083 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:08.221056    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"]
Jul 09 04:58:08.222622 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:58:08.222595    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f19c60_2986_4206_a0eb_6d0030328df1.slice/crio-308083ad2a6290c5dee8bdb17b477d9e0b4bc1338ac24e293252c131a2f10664 WatchSource:0}: Error finding container 308083ad2a6290c5dee8bdb17b477d9e0b4bc1338ac24e293252c131a2f10664: Status 404 returned error can't find the container with id 308083ad2a6290c5dee8bdb17b477d9e0b4bc1338ac24e293252c131a2f10664
Jul 09 04:58:08.224020 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:08.224002    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:58:08.470317 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:08.470232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7" event={"ID":"c4f19c60-2986-4206-a0eb-6d0030328df1","Type":"ContainerStarted","Data":"308083ad2a6290c5dee8bdb17b477d9e0b4bc1338ac24e293252c131a2f10664"}
Jul 09 04:58:09.477898 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:09.477862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7" event={"ID":"c4f19c60-2986-4206-a0eb-6d0030328df1","Type":"ContainerStarted","Data":"a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5"}
Jul 09 04:58:09.478460 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:09.477987    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:09.495659 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:09.495592    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7" podStartSLOduration=2.10230712 podStartE2EDuration="2.495573816s" totalImagesPullingTime="393.266696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:58:09.493333492 +0000 UTC m=+1556.653754011" watchObservedRunningTime="2026-07-09 04:58:09.495573816 +0000 UTC m=+1556.655994354"
Jul 09 04:58:12.949872 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:12.949823    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"]
Jul 09 04:58:12.950326 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:12.950069    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7" podUID="c4f19c60-2986-4206-a0eb-6d0030328df1" containerName="maas-api" containerID="cri-o://a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5" gracePeriod=30
Jul 09 04:58:13.199324 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.199301    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:13.222654 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.222559    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f19c60-2986-4206-a0eb-6d0030328df1-openshift-service-ca\") pod \"c4f19c60-2986-4206-a0eb-6d0030328df1\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") "
Jul 09 04:58:13.222654 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.222604    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82mx2\" (UniqueName: \"kubernetes.io/projected/c4f19c60-2986-4206-a0eb-6d0030328df1-kube-api-access-82mx2\") pod \"c4f19c60-2986-4206-a0eb-6d0030328df1\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") "
Jul 09 04:58:13.222900 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.222688    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f19c60-2986-4206-a0eb-6d0030328df1-maas-api-tls\") pod \"c4f19c60-2986-4206-a0eb-6d0030328df1\" (UID: \"c4f19c60-2986-4206-a0eb-6d0030328df1\") "
Jul 09 04:58:13.222959 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.222920    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4f19c60-2986-4206-a0eb-6d0030328df1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4f19c60-2986-4206-a0eb-6d0030328df1" (UID: "c4f19c60-2986-4206-a0eb-6d0030328df1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:58:13.224781 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.224753    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f19c60-2986-4206-a0eb-6d0030328df1-kube-api-access-82mx2" (OuterVolumeSpecName: "kube-api-access-82mx2") pod "c4f19c60-2986-4206-a0eb-6d0030328df1" (UID: "c4f19c60-2986-4206-a0eb-6d0030328df1"). InnerVolumeSpecName "kube-api-access-82mx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:58:13.224781 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.224763    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f19c60-2986-4206-a0eb-6d0030328df1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4f19c60-2986-4206-a0eb-6d0030328df1" (UID: "c4f19c60-2986-4206-a0eb-6d0030328df1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:58:13.323606 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.323567    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82mx2\" (UniqueName: \"kubernetes.io/projected/c4f19c60-2986-4206-a0eb-6d0030328df1-kube-api-access-82mx2\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:13.323606 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.323599    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f19c60-2986-4206-a0eb-6d0030328df1-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:13.323606 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.323611    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f19c60-2986-4206-a0eb-6d0030328df1-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:13.499602 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.499566    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f19c60-2986-4206-a0eb-6d0030328df1" containerID="a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5" exitCode=0
Jul 09 04:58:13.499823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.499609    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"
Jul 09 04:58:13.499823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.499671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7" event={"ID":"c4f19c60-2986-4206-a0eb-6d0030328df1","Type":"ContainerDied","Data":"a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5"}
Jul 09 04:58:13.499823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.499722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7" event={"ID":"c4f19c60-2986-4206-a0eb-6d0030328df1","Type":"ContainerDied","Data":"308083ad2a6290c5dee8bdb17b477d9e0b4bc1338ac24e293252c131a2f10664"}
Jul 09 04:58:13.499823 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.499743    2563 scope.go:117] "RemoveContainer" containerID="a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5"
Jul 09 04:58:13.509888 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.509872    2563 scope.go:117] "RemoveContainer" containerID="a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5"
Jul 09 04:58:13.510214 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:13.510193    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5\": container with ID starting with a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5 not found: ID does not exist" containerID="a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5"
Jul 09 04:58:13.510279 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.510223    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5"} err="failed to get container status \"a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5\": rpc error: code = NotFound desc = could not find container \"a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5\": container with ID starting with a3a3ea95b62520f2e7417e71496b2445e3b5b906862ef370c3f217cfe815b8b5 not found: ID does not exist"
Jul 09 04:58:13.520347 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.520316    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"]
Jul 09 04:58:13.526066 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:13.526042    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-985e40e4-7fc56d9dc4-vgzb7"]
Jul 09 04:58:14.702606 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:14.702572    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4f19c60-2986-4206-a0eb-6d0030328df1" path="/var/lib/kubelet/pods/c4f19c60-2986-4206-a0eb-6d0030328df1/volumes"
Jul 09 04:58:20.342397 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.342355    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"]
Jul 09 04:58:20.351604 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.351568    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f19c60-2986-4206-a0eb-6d0030328df1" containerName="maas-api"
Jul 09 04:58:20.352049 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.352018    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f19c60-2986-4206-a0eb-6d0030328df1" containerName="maas-api"
Jul 09 04:58:20.352376 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.352341    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f19c60-2986-4206-a0eb-6d0030328df1" containerName="maas-api"
Jul 09 04:58:20.356563 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.356539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.356766 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.356562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"]
Jul 09 04:58:20.358693 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.358670    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9b4ec329-serving-cert\""
Jul 09 04:58:20.373943 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.373918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.374066 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.373950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b4af89-e4ce-4863-a856-9aa53dea8292-openshift-service-ca\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.374066 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.373981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxmtm\" (UniqueName: \"kubernetes.io/projected/c8b4af89-e4ce-4863-a856-9aa53dea8292-kube-api-access-fxmtm\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.474891 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.474857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.474891 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.474892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b4af89-e4ce-4863-a856-9aa53dea8292-openshift-service-ca\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.475143 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.474923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxmtm\" (UniqueName: \"kubernetes.io/projected/c8b4af89-e4ce-4863-a856-9aa53dea8292-kube-api-access-fxmtm\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.475143 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:20.475056    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-serving-cert: secret "maas-api-e2e-ait-9b4ec329-serving-cert" not found
Jul 09 04:58:20.475143 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:20.475136    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls podName:c8b4af89-e4ce-4863-a856-9aa53dea8292 nodeName:}" failed. No retries permitted until 2026-07-09 04:58:20.975114473 +0000 UTC m=+1568.135534982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls") pod "maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g" (UID: "c8b4af89-e4ce-4863-a856-9aa53dea8292") : secret "maas-api-e2e-ait-9b4ec329-serving-cert" not found
Jul 09 04:58:20.475525 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.475504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b4af89-e4ce-4863-a856-9aa53dea8292-openshift-service-ca\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.489082 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.489051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxmtm\" (UniqueName: \"kubernetes.io/projected/c8b4af89-e4ce-4863-a856-9aa53dea8292-kube-api-access-fxmtm\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.978511 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.978468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:20.981029 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:20.981006    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls\") pod \"maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:21.270367 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:21.270263    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:21.405975 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:21.405950    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"]
Jul 09 04:58:21.408056 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:58:21.408024    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b4af89_e4ce_4863_a856_9aa53dea8292.slice/crio-72a50bc8a606a1e921e85b1b08d6c1dbe6460e3c0624544072be5e72436a56fb WatchSource:0}: Error finding container 72a50bc8a606a1e921e85b1b08d6c1dbe6460e3c0624544072be5e72436a56fb: Status 404 returned error can't find the container with id 72a50bc8a606a1e921e85b1b08d6c1dbe6460e3c0624544072be5e72436a56fb
Jul 09 04:58:21.547879 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:21.547788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g" event={"ID":"c8b4af89-e4ce-4863-a856-9aa53dea8292","Type":"ContainerStarted","Data":"72a50bc8a606a1e921e85b1b08d6c1dbe6460e3c0624544072be5e72436a56fb"}
Jul 09 04:58:22.554531 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:22.554498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g" event={"ID":"c8b4af89-e4ce-4863-a856-9aa53dea8292","Type":"ContainerStarted","Data":"7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187"}
Jul 09 04:58:22.555046 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:22.554626    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:22.570547 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:22.570499    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g" podStartSLOduration=2.201321715 podStartE2EDuration="2.570478102s" totalImagesPullingTime="369.156387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:58:22.569344415 +0000 UTC m=+1569.729764948" watchObservedRunningTime="2026-07-09 04:58:22.570478102 +0000 UTC m=+1569.730898649"
Jul 09 04:58:25.482250 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.482212    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"]
Jul 09 04:58:25.482743 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.482442    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g" podUID="c8b4af89-e4ce-4863-a856-9aa53dea8292" containerName="maas-api" containerID="cri-o://7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187" gracePeriod=30
Jul 09 04:58:25.729153 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.729125    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:25.823839 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.823752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls\") pod \"c8b4af89-e4ce-4863-a856-9aa53dea8292\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") "
Jul 09 04:58:25.823839 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.823825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b4af89-e4ce-4863-a856-9aa53dea8292-openshift-service-ca\") pod \"c8b4af89-e4ce-4863-a856-9aa53dea8292\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") "
Jul 09 04:58:25.824024 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.823862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxmtm\" (UniqueName: \"kubernetes.io/projected/c8b4af89-e4ce-4863-a856-9aa53dea8292-kube-api-access-fxmtm\") pod \"c8b4af89-e4ce-4863-a856-9aa53dea8292\" (UID: \"c8b4af89-e4ce-4863-a856-9aa53dea8292\") "
Jul 09 04:58:25.824221 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.824195    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b4af89-e4ce-4863-a856-9aa53dea8292-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8b4af89-e4ce-4863-a856-9aa53dea8292" (UID: "c8b4af89-e4ce-4863-a856-9aa53dea8292"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:58:25.825928 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.825908    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b4af89-e4ce-4863-a856-9aa53dea8292-kube-api-access-fxmtm" (OuterVolumeSpecName: "kube-api-access-fxmtm") pod "c8b4af89-e4ce-4863-a856-9aa53dea8292" (UID: "c8b4af89-e4ce-4863-a856-9aa53dea8292"). InnerVolumeSpecName "kube-api-access-fxmtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:58:25.826051 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.826036    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8b4af89-e4ce-4863-a856-9aa53dea8292" (UID: "c8b4af89-e4ce-4863-a856-9aa53dea8292"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:58:25.924992 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.924952    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b4af89-e4ce-4863-a856-9aa53dea8292-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:25.924992 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.924986    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxmtm\" (UniqueName: \"kubernetes.io/projected/c8b4af89-e4ce-4863-a856-9aa53dea8292-kube-api-access-fxmtm\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:25.924992 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:25.924996    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8b4af89-e4ce-4863-a856-9aa53dea8292-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:26.575485 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.575448    2563 generic.go:356] "Generic (PLEG): container finished" podID="c8b4af89-e4ce-4863-a856-9aa53dea8292" containerID="7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187" exitCode=0
Jul 09 04:58:26.575953 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.575498    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"
Jul 09 04:58:26.575953 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.575520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g" event={"ID":"c8b4af89-e4ce-4863-a856-9aa53dea8292","Type":"ContainerDied","Data":"7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187"}
Jul 09 04:58:26.575953 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.575579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g" event={"ID":"c8b4af89-e4ce-4863-a856-9aa53dea8292","Type":"ContainerDied","Data":"72a50bc8a606a1e921e85b1b08d6c1dbe6460e3c0624544072be5e72436a56fb"}
Jul 09 04:58:26.575953 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.575608    2563 scope.go:117] "RemoveContainer" containerID="7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187"
Jul 09 04:58:26.588800 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.588609    2563 scope.go:117] "RemoveContainer" containerID="7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187"
Jul 09 04:58:26.589225 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:26.589199    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187\": container with ID starting with 7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187 not found: ID does not exist" containerID="7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187"
Jul 09 04:58:26.589311 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.589235    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187"} err="failed to get container status \"7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187\": rpc error: code = NotFound desc = could not find container \"7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187\": container with ID starting with 7a309b2ab564f81a7b4c3bd7205afe6a5ba9f8816a583e6561c974b3793b8187 not found: ID does not exist"
Jul 09 04:58:26.613265 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.613233    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"]
Jul 09 04:58:26.621752 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.621723    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b4ec329-65846d44d5-jfb4g"]
Jul 09 04:58:26.705131 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:26.705098    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b4af89-e4ce-4863-a856-9aa53dea8292" path="/var/lib/kubelet/pods/c8b4af89-e4ce-4863-a856-9aa53dea8292/volumes"
Jul 09 04:58:38.412447 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.412404    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"]
Jul 09 04:58:38.413053 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.412996    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b4af89-e4ce-4863-a856-9aa53dea8292" containerName="maas-api"
Jul 09 04:58:38.413053 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.413019    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b4af89-e4ce-4863-a856-9aa53dea8292" containerName="maas-api"
Jul 09 04:58:38.413177 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.413129    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b4af89-e4ce-4863-a856-9aa53dea8292" containerName="maas-api"
Jul 09 04:58:38.417599 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.417570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.420129 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.420108    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-610b04b1-serving-cert\""
Jul 09 04:58:38.428745 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.428716    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"]
Jul 09 04:58:38.534201 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.534154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-openshift-service-ca\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.534419 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.534211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-kube-api-access-5dz62\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.534419 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.534346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.635336 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.635298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-kube-api-access-5dz62\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.635535 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.635407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.635535 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.635436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-openshift-service-ca\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.635700 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:38.635583    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-serving-cert: secret "maas-api-e2e-derive-610b04b1-serving-cert" not found
Jul 09 04:58:38.635764 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:38.635709    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls podName:2c6297d3-c2cc-4fdf-be3a-22ed9b051926 nodeName:}" failed. No retries permitted until 2026-07-09 04:58:39.135684551 +0000 UTC m=+1586.296105050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls") pod "maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" (UID: "2c6297d3-c2cc-4fdf-be3a-22ed9b051926") : secret "maas-api-e2e-derive-610b04b1-serving-cert" not found
Jul 09 04:58:38.636092 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.636071    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-openshift-service-ca\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:38.646987 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:38.646956    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-kube-api-access-5dz62\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:39.142752 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:39.142712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:39.142945 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:39.142841    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-serving-cert: secret "maas-api-e2e-derive-610b04b1-serving-cert" not found
Jul 09 04:58:39.142945 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:39.142912    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls podName:2c6297d3-c2cc-4fdf-be3a-22ed9b051926 nodeName:}" failed. No retries permitted until 2026-07-09 04:58:40.14289188 +0000 UTC m=+1587.303312378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls") pod "maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" (UID: "2c6297d3-c2cc-4fdf-be3a-22ed9b051926") : secret "maas-api-e2e-derive-610b04b1-serving-cert" not found
Jul 09 04:58:40.151179 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:40.151140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:40.153550 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:40.153527    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls\") pod \"maas-api-e2e-derive-610b04b1-5796594d5-9c4j9\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:40.231604 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:40.231572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:40.379036 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:40.379009    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"]
Jul 09 04:58:40.380869 ip-10-0-134-202 kubenswrapper[2563]: W0709 04:58:40.380844    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6297d3_c2cc_4fdf_be3a_22ed9b051926.slice/crio-c1fbf85e3736f0d565b291021adec52d44579609f4f20395591f2aa18d542718 WatchSource:0}: Error finding container c1fbf85e3736f0d565b291021adec52d44579609f4f20395591f2aa18d542718: Status 404 returned error can't find the container with id c1fbf85e3736f0d565b291021adec52d44579609f4f20395591f2aa18d542718
Jul 09 04:58:40.652519 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:40.652479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" event={"ID":"2c6297d3-c2cc-4fdf-be3a-22ed9b051926","Type":"ContainerStarted","Data":"c1fbf85e3736f0d565b291021adec52d44579609f4f20395591f2aa18d542718"}
Jul 09 04:58:41.659469 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:41.659431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" event={"ID":"2c6297d3-c2cc-4fdf-be3a-22ed9b051926","Type":"ContainerStarted","Data":"ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b"}
Jul 09 04:58:41.659973 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:41.659562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:41.676853 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:41.676801    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" podStartSLOduration=3.31660288 podStartE2EDuration="3.676782896s" totalImagesPullingTime="360.180016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:58:41.674379164 +0000 UTC m=+1588.834799686" watchObservedRunningTime="2026-07-09 04:58:41.676782896 +0000 UTC m=+1588.837203779"
Jul 09 04:58:43.236313 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.236274    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"]
Jul 09 04:58:43.670940 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.670831    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" podUID="2c6297d3-c2cc-4fdf-be3a-22ed9b051926" containerName="maas-api" containerID="cri-o://ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b" gracePeriod=30
Jul 09 04:58:43.913606 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.913582    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:43.989078 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.989045    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-openshift-service-ca\") pod \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") "
Jul 09 04:58:43.989271 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.989092    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls\") pod \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") "
Jul 09 04:58:43.989271 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.989141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-kube-api-access-5dz62\") pod \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\" (UID: \"2c6297d3-c2cc-4fdf-be3a-22ed9b051926\") "
Jul 09 04:58:43.989469 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.989435    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c6297d3-c2cc-4fdf-be3a-22ed9b051926" (UID: "2c6297d3-c2cc-4fdf-be3a-22ed9b051926"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:58:43.991145 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.991119    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c6297d3-c2cc-4fdf-be3a-22ed9b051926" (UID: "2c6297d3-c2cc-4fdf-be3a-22ed9b051926"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:58:43.991253 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:43.991217    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-kube-api-access-5dz62" (OuterVolumeSpecName: "kube-api-access-5dz62") pod "2c6297d3-c2cc-4fdf-be3a-22ed9b051926" (UID: "2c6297d3-c2cc-4fdf-be3a-22ed9b051926"). InnerVolumeSpecName "kube-api-access-5dz62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:58:44.090387 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.090332    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:44.090387 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.090382    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:44.090387 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.090391    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/2c6297d3-c2cc-4fdf-be3a-22ed9b051926-kube-api-access-5dz62\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 04:58:44.678141 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.678108    2563 generic.go:356] "Generic (PLEG): container finished" podID="2c6297d3-c2cc-4fdf-be3a-22ed9b051926" containerID="ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b" exitCode=0
Jul 09 04:58:44.678626 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.678165    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"
Jul 09 04:58:44.678626 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.678163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" event={"ID":"2c6297d3-c2cc-4fdf-be3a-22ed9b051926","Type":"ContainerDied","Data":"ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b"}
Jul 09 04:58:44.678626 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.678233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9" event={"ID":"2c6297d3-c2cc-4fdf-be3a-22ed9b051926","Type":"ContainerDied","Data":"c1fbf85e3736f0d565b291021adec52d44579609f4f20395591f2aa18d542718"}
Jul 09 04:58:44.678626 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.678265    2563 scope.go:117] "RemoveContainer" containerID="ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b"
Jul 09 04:58:44.687927 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.687909    2563 scope.go:117] "RemoveContainer" containerID="ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b"
Jul 09 04:58:44.688201 ip-10-0-134-202 kubenswrapper[2563]: E0709 04:58:44.688181    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b\": container with ID starting with ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b not found: ID does not exist" containerID="ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b"
Jul 09 04:58:44.688287 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.688209    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b"} err="failed to get container status \"ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b\": rpc error: code = NotFound desc = could not find container \"ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b\": container with ID starting with ed17ae0e1b489da22ffad6f94357835250466914e497c08e2437609fbea6401b not found: ID does not exist"
Jul 09 04:58:44.710200 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.710166    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"]
Jul 09 04:58:44.710424 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:44.710410    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-610b04b1-5796594d5-9c4j9"]
Jul 09 04:58:46.701903 ip-10-0-134-202 kubenswrapper[2563]: I0709 04:58:46.701868    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c6297d3-c2cc-4fdf-be3a-22ed9b051926" path="/var/lib/kubelet/pods/2c6297d3-c2cc-4fdf-be3a-22ed9b051926/volumes"
Jul 09 05:00:00.136771 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.136737    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"]
Jul 09 05:00:00.137255 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.137124    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6297d3-c2cc-4fdf-be3a-22ed9b051926" containerName="maas-api"
Jul 09 05:00:00.137255 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.137134    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6297d3-c2cc-4fdf-be3a-22ed9b051926" containerName="maas-api"
Jul 09 05:00:00.137255 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.137199    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c6297d3-c2cc-4fdf-be3a-22ed9b051926" containerName="maas-api"
Jul 09 05:00:00.140337 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.140320    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"
Jul 09 05:00:00.146685 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.146654    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"]
Jul 09 05:00:00.154956 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.154930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqj2\" (UniqueName: \"kubernetes.io/projected/075b6ce1-d4a1-4163-aa75-75b347df967f-kube-api-access-fvqj2\") pod \"maas-api-key-cleanup-29726220-sphb7\" (UID: \"075b6ce1-d4a1-4163-aa75-75b347df967f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"
Jul 09 05:00:00.255744 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.255699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqj2\" (UniqueName: \"kubernetes.io/projected/075b6ce1-d4a1-4163-aa75-75b347df967f-kube-api-access-fvqj2\") pod \"maas-api-key-cleanup-29726220-sphb7\" (UID: \"075b6ce1-d4a1-4163-aa75-75b347df967f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"
Jul 09 05:00:00.269828 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.269794    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqj2\" (UniqueName: \"kubernetes.io/projected/075b6ce1-d4a1-4163-aa75-75b347df967f-kube-api-access-fvqj2\") pod \"maas-api-key-cleanup-29726220-sphb7\" (UID: \"075b6ce1-d4a1-4163-aa75-75b347df967f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"
Jul 09 05:00:00.451977 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.451883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"
Jul 09 05:00:00.595481 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:00.595455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"]
Jul 09 05:00:00.597542 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:00:00.597512    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075b6ce1_d4a1_4163_aa75_75b347df967f.slice/crio-10dcda1c8596201bbcb20094032903864587e9fcdfdc710cb471a0be710a4c3c WatchSource:0}: Error finding container 10dcda1c8596201bbcb20094032903864587e9fcdfdc710cb471a0be710a4c3c: Status 404 returned error can't find the container with id 10dcda1c8596201bbcb20094032903864587e9fcdfdc710cb471a0be710a4c3c
Jul 09 05:00:01.073081 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:01.072985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7" event={"ID":"075b6ce1-d4a1-4163-aa75-75b347df967f","Type":"ContainerStarted","Data":"39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1"}
Jul 09 05:00:01.073081 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:01.073039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7" event={"ID":"075b6ce1-d4a1-4163-aa75-75b347df967f","Type":"ContainerStarted","Data":"10dcda1c8596201bbcb20094032903864587e9fcdfdc710cb471a0be710a4c3c"}
Jul 09 05:00:01.092056 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:01.092002    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7" podStartSLOduration=1.091984815 podStartE2EDuration="1.091984815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:00:01.091088786 +0000 UTC m=+1668.251509306" watchObservedRunningTime="2026-07-09 05:00:01.091984815 +0000 UTC m=+1668.252405334"
Jul 09 05:00:26.092310 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.092265    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"]
Jul 09 05:00:26.096348 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.096327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.098791 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.098766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ae534da9-serving-cert\""
Jul 09 05:00:26.105709 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.105685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"]
Jul 09 05:00:26.192283 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.192236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbscn\" (UniqueName: \"kubernetes.io/projected/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-kube-api-access-nbscn\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.192468 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.192300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-openshift-service-ca\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.192468 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.192337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-maas-api-tls\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.292963 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.292926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-openshift-service-ca\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.292963 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.292966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-maas-api-tls\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.293191 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.293037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbscn\" (UniqueName: \"kubernetes.io/projected/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-kube-api-access-nbscn\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.293687 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.293627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-openshift-service-ca\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.295449 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.295428    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-maas-api-tls\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.301086 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.301063    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbscn\" (UniqueName: \"kubernetes.io/projected/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-kube-api-access-nbscn\") pod \"maas-api-e2e-mt-ae534da9-54f454596f-tccwm\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.409093 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.409007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:26.547276 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:26.547252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"]
Jul 09 05:00:26.549497 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:00:26.549463    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9df5a58_a312_4d64_8c8d_6c53b5e03b3d.slice/crio-563b18faf2f146d2b38f836d37d859272bb5c2aa4202b39a1152d558179be8a1 WatchSource:0}: Error finding container 563b18faf2f146d2b38f836d37d859272bb5c2aa4202b39a1152d558179be8a1: Status 404 returned error can't find the container with id 563b18faf2f146d2b38f836d37d859272bb5c2aa4202b39a1152d558179be8a1
Jul 09 05:00:27.207904 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:27.207871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm" event={"ID":"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d","Type":"ContainerStarted","Data":"86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130"}
Jul 09 05:00:27.208300 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:27.207923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm" event={"ID":"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d","Type":"ContainerStarted","Data":"563b18faf2f146d2b38f836d37d859272bb5c2aa4202b39a1152d558179be8a1"}
Jul 09 05:00:27.208300 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:27.207944    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:27.242061 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:27.242009    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm" podStartSLOduration=0.756029855 podStartE2EDuration="1.241994028s" totalImagesPullingTime="485.964173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:00:27.239994942 +0000 UTC m=+1694.400415461" watchObservedRunningTime="2026-07-09 05:00:27.241994028 +0000 UTC m=+1694.402414548"
Jul 09 05:00:33.218564 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:33.218529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:37.926775 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:37.926693    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"]
Jul 09 05:00:37.927247 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:37.926931    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm" podUID="e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" containerName="maas-api" containerID="cri-o://86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130" gracePeriod=30
Jul 09 05:00:38.174436 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.174408    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:38.272739 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.272703    2563 generic.go:356] "Generic (PLEG): container finished" podID="e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" containerID="86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130" exitCode=0
Jul 09 05:00:38.272951 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.272745    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"
Jul 09 05:00:38.272951 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.272764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm" event={"ID":"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d","Type":"ContainerDied","Data":"86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130"}
Jul 09 05:00:38.272951 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.272844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm" event={"ID":"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d","Type":"ContainerDied","Data":"563b18faf2f146d2b38f836d37d859272bb5c2aa4202b39a1152d558179be8a1"}
Jul 09 05:00:38.272951 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.272873    2563 scope.go:117] "RemoveContainer" containerID="86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130"
Jul 09 05:00:38.283025 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.283005    2563 scope.go:117] "RemoveContainer" containerID="86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130"
Jul 09 05:00:38.283320 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:00:38.283298    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130\": container with ID starting with 86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130 not found: ID does not exist" containerID="86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130"
Jul 09 05:00:38.283373 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.283334    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130"} err="failed to get container status \"86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130\": rpc error: code = NotFound desc = could not find container \"86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130\": container with ID starting with 86e01e35c8f885174480334790d6590fcd0af3340507d7614eaae18dd94a9130 not found: ID does not exist"
Jul 09 05:00:38.295686 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.295664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-openshift-service-ca\") pod \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") "
Jul 09 05:00:38.295818 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.295791    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbscn\" (UniqueName: \"kubernetes.io/projected/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-kube-api-access-nbscn\") pod \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") "
Jul 09 05:00:38.295882 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.295824    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-maas-api-tls\") pod \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\" (UID: \"e9df5a58-a312-4d64-8c8d-6c53b5e03b3d\") "
Jul 09 05:00:38.296037 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.296012    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" (UID: "e9df5a58-a312-4d64-8c8d-6c53b5e03b3d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:00:38.297773 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.297747    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-kube-api-access-nbscn" (OuterVolumeSpecName: "kube-api-access-nbscn") pod "e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" (UID: "e9df5a58-a312-4d64-8c8d-6c53b5e03b3d"). InnerVolumeSpecName "kube-api-access-nbscn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:00:38.297925 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.297910    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" (UID: "e9df5a58-a312-4d64-8c8d-6c53b5e03b3d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:00:38.396533 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.396500    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbscn\" (UniqueName: \"kubernetes.io/projected/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-kube-api-access-nbscn\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:00:38.396533 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.396527    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:00:38.396533 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.396538    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:00:38.595599 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.595566    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"]
Jul 09 05:00:38.605805 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.605779    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae534da9-54f454596f-tccwm"]
Jul 09 05:00:38.703209 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:00:38.703177    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" path="/var/lib/kubelet/pods/e9df5a58-a312-4d64-8c8d-6c53b5e03b3d/volumes"
Jul 09 05:01:00.013371 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:00.013329    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"]
Jul 09 05:01:00.013887 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:00.013539    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7" podUID="075b6ce1-d4a1-4163-aa75-75b347df967f" containerName="cleanup" containerID="cri-o://39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1" gracePeriod=30
Jul 09 05:01:06.256609 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.256564    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"]
Jul 09 05:01:06.257146 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.257130    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" containerName="maas-api"
Jul 09 05:01:06.257198 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.257150    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" containerName="maas-api"
Jul 09 05:01:06.257247 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.257236    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9df5a58-a312-4d64-8c8d-6c53b5e03b3d" containerName="maas-api"
Jul 09 05:01:06.261167 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.261150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.265191 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.265163    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8146f0d0-serving-cert\""
Jul 09 05:01:06.270865 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.270839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"]
Jul 09 05:01:06.343853 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.343816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-openshift-service-ca\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.344086 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.343875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-522zt\" (UniqueName: \"kubernetes.io/projected/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-kube-api-access-522zt\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.344086 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.343928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.444785 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.444753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-openshift-service-ca\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.444970 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.444817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-522zt\" (UniqueName: \"kubernetes.io/projected/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-kube-api-access-522zt\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.444970 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.444841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.444970 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:01:06.444966    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-serving-cert: secret "maas-api-e2e-mt-8146f0d0-serving-cert" not found
Jul 09 05:01:06.445104 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:01:06.445039    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls podName:5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64 nodeName:}" failed. No retries permitted until 2026-07-09 05:01:06.945022473 +0000 UTC m=+1734.105442989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls") pod "maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72" (UID: "5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64") : secret "maas-api-e2e-mt-8146f0d0-serving-cert" not found
Jul 09 05:01:06.445540 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.445517    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-openshift-service-ca\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.453664 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.453625    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-522zt\" (UniqueName: \"kubernetes.io/projected/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-kube-api-access-522zt\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.949455 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.949418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:06.951898 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:06.951869    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls\") pod \"maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:07.173939 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:07.173896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:07.319482 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:07.319456    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"]
Jul 09 05:01:07.321381 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:01:07.321358    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e35d5bb_a7fe_4e7a_9942_b1eb49a8bf64.slice/crio-f828314079adf349745c7691fb77568f11641b7f61a8edf71507173b23810448 WatchSource:0}: Error finding container f828314079adf349745c7691fb77568f11641b7f61a8edf71507173b23810448: Status 404 returned error can't find the container with id f828314079adf349745c7691fb77568f11641b7f61a8edf71507173b23810448
Jul 09 05:01:07.428340 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:07.428299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72" event={"ID":"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64","Type":"ContainerStarted","Data":"f828314079adf349745c7691fb77568f11641b7f61a8edf71507173b23810448"}
Jul 09 05:01:08.435863 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:08.435770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72" event={"ID":"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64","Type":"ContainerStarted","Data":"c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d"}
Jul 09 05:01:08.436293 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:08.435905    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:08.452871 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:08.452819    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72" podStartSLOduration=1.746886868 podStartE2EDuration="2.452803274s" totalImagesPullingTime="705.916406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:01:08.451212818 +0000 UTC m=+1735.611633341" watchObservedRunningTime="2026-07-09 05:01:08.452803274 +0000 UTC m=+1735.613223797"
Jul 09 05:01:14.446854 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:14.446816    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:30.197158 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.197134    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"
Jul 09 05:01:30.359045 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.358949    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvqj2\" (UniqueName: \"kubernetes.io/projected/075b6ce1-d4a1-4163-aa75-75b347df967f-kube-api-access-fvqj2\") pod \"075b6ce1-d4a1-4163-aa75-75b347df967f\" (UID: \"075b6ce1-d4a1-4163-aa75-75b347df967f\") "
Jul 09 05:01:30.361066 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.361035    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/075b6ce1-d4a1-4163-aa75-75b347df967f-kube-api-access-fvqj2" (OuterVolumeSpecName: "kube-api-access-fvqj2") pod "075b6ce1-d4a1-4163-aa75-75b347df967f" (UID: "075b6ce1-d4a1-4163-aa75-75b347df967f"). InnerVolumeSpecName "kube-api-access-fvqj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:01:30.459569 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.459520    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvqj2\" (UniqueName: \"kubernetes.io/projected/075b6ce1-d4a1-4163-aa75-75b347df967f-kube-api-access-fvqj2\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:01:30.555760 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.555725    2563 generic.go:356] "Generic (PLEG): container finished" podID="075b6ce1-d4a1-4163-aa75-75b347df967f" containerID="39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1" exitCode=137
Jul 09 05:01:30.555969 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.555762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7" event={"ID":"075b6ce1-d4a1-4163-aa75-75b347df967f","Type":"ContainerDied","Data":"39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1"}
Jul 09 05:01:30.555969 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.555779    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"
Jul 09 05:01:30.555969 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.555820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7" event={"ID":"075b6ce1-d4a1-4163-aa75-75b347df967f","Type":"ContainerDied","Data":"10dcda1c8596201bbcb20094032903864587e9fcdfdc710cb471a0be710a4c3c"}
Jul 09 05:01:30.555969 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.555844    2563 scope.go:117] "RemoveContainer" containerID="39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1"
Jul 09 05:01:30.564655 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.564622    2563 scope.go:117] "RemoveContainer" containerID="39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1"
Jul 09 05:01:30.564951 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:01:30.564927    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1\": container with ID starting with 39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1 not found: ID does not exist" containerID="39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1"
Jul 09 05:01:30.565045 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.564957    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1"} err="failed to get container status \"39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1\": rpc error: code = NotFound desc = could not find container \"39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1\": container with ID starting with 39930e01307f334647b29c5fe75fc43b5d6eb7f69f0f40a71806772a052f5cc1 not found: ID does not exist"
Jul 09 05:01:30.577491 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.577452    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"]
Jul 09 05:01:30.581424 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.581397    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726220-sphb7"]
Jul 09 05:01:30.701592 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:30.701492    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="075b6ce1-d4a1-4163-aa75-75b347df967f" path="/var/lib/kubelet/pods/075b6ce1-d4a1-4163-aa75-75b347df967f/volumes"
Jul 09 05:01:48.571023 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.570989    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"]
Jul 09 05:01:48.571591 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.571190    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72" podUID="5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" containerName="maas-api" containerID="cri-o://c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d" gracePeriod=30
Jul 09 05:01:48.823748 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.823684    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:48.904358 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.904324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls\") pod \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") "
Jul 09 05:01:48.904533 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.904369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-openshift-service-ca\") pod \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") "
Jul 09 05:01:48.904533 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.904399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-522zt\" (UniqueName: \"kubernetes.io/projected/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-kube-api-access-522zt\") pod \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\" (UID: \"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64\") "
Jul 09 05:01:48.904744 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.904720    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" (UID: "5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:01:48.906555 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.906532    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-kube-api-access-522zt" (OuterVolumeSpecName: "kube-api-access-522zt") pod "5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" (UID: "5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64"). InnerVolumeSpecName "kube-api-access-522zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:01:48.906677 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:48.906539    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" (UID: "5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:01:49.006152 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.006108    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:01:49.006152 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.006145    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-522zt\" (UniqueName: \"kubernetes.io/projected/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-kube-api-access-522zt\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:01:49.006152 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.006161    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:01:49.664437 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.664400    2563 generic.go:356] "Generic (PLEG): container finished" podID="5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" containerID="c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d" exitCode=0
Jul 09 05:01:49.664437 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.664435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72" event={"ID":"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64","Type":"ContainerDied","Data":"c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d"}
Jul 09 05:01:49.665015 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.664451    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"
Jul 09 05:01:49.665015 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.664473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72" event={"ID":"5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64","Type":"ContainerDied","Data":"f828314079adf349745c7691fb77568f11641b7f61a8edf71507173b23810448"}
Jul 09 05:01:49.665015 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.664495    2563 scope.go:117] "RemoveContainer" containerID="c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d"
Jul 09 05:01:49.674514 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.674489    2563 scope.go:117] "RemoveContainer" containerID="c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d"
Jul 09 05:01:49.674861 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:01:49.674836    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d\": container with ID starting with c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d not found: ID does not exist" containerID="c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d"
Jul 09 05:01:49.674932 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.674871    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d"} err="failed to get container status \"c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d\": rpc error: code = NotFound desc = could not find container \"c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d\": container with ID starting with c8e16a2963cb06745dfd9a2263057be3a910854a897911757b75e569dffab66d not found: ID does not exist"
Jul 09 05:01:49.686384 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.686351    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"]
Jul 09 05:01:49.689463 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:49.689440    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8146f0d0-6f44cbb8c6-4ps72"]
Jul 09 05:01:50.701822 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:01:50.701784    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" path="/var/lib/kubelet/pods/5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64/volumes"
Jul 09 05:02:13.342186 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:02:13.342059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 05:02:13.355611 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:02:13.350031    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 05:03:39.984282 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.984198    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"]
Jul 09 05:03:39.984755 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.984739    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" containerName="maas-api"
Jul 09 05:03:39.984806 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.984758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" containerName="maas-api"
Jul 09 05:03:39.984806 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.984779    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="075b6ce1-d4a1-4163-aa75-75b347df967f" containerName="cleanup"
Jul 09 05:03:39.984806 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.984793    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="075b6ce1-d4a1-4163-aa75-75b347df967f" containerName="cleanup"
Jul 09 05:03:39.984919 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.984909    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="075b6ce1-d4a1-4163-aa75-75b347df967f" containerName="cleanup"
Jul 09 05:03:39.984959 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.984928    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e35d5bb-a7fe-4e7a-9942-b1eb49a8bf64" containerName="maas-api"
Jul 09 05:03:39.988442 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.988423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:39.990779 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.990757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-61a9e8-serving-cert\""
Jul 09 05:03:39.997527 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:39.997494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"]
Jul 09 05:03:40.080136 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.080083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70052ea-9c63-4d92-830c-5bfa62236ad5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.080332 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.080155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnpf\" (UniqueName: \"kubernetes.io/projected/d70052ea-9c63-4d92-830c-5bfa62236ad5-kube-api-access-zqnpf\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.080332 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.080225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.180765 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.180729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.180946 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.180821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70052ea-9c63-4d92-830c-5bfa62236ad5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.180946 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.180870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnpf\" (UniqueName: \"kubernetes.io/projected/d70052ea-9c63-4d92-830c-5bfa62236ad5-kube-api-access-zqnpf\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.180946 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:03:40.180901    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-serving-cert: secret "maas-api-e2e-inf-a-61a9e8-serving-cert" not found
Jul 09 05:03:40.181076 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:03:40.180967    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls podName:d70052ea-9c63-4d92-830c-5bfa62236ad5 nodeName:}" failed. No retries permitted until 2026-07-09 05:03:40.68094543 +0000 UTC m=+1887.841365938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls") pod "maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf" (UID: "d70052ea-9c63-4d92-830c-5bfa62236ad5") : secret "maas-api-e2e-inf-a-61a9e8-serving-cert" not found
Jul 09 05:03:40.181539 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.181518    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70052ea-9c63-4d92-830c-5bfa62236ad5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.193587 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.193558    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnpf\" (UniqueName: \"kubernetes.io/projected/d70052ea-9c63-4d92-830c-5bfa62236ad5-kube-api-access-zqnpf\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.685596 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.685552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.688075 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.688050    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls\") pod \"maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:40.900671 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:40.900611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:41.036170 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:41.036145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"]
Jul 09 05:03:41.037610 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:03:41.037578    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70052ea_9c63_4d92_830c_5bfa62236ad5.slice/crio-a520323188f46507dc8c86921494f649956440bbee6e304aa9437ecc08ce1adf WatchSource:0}: Error finding container a520323188f46507dc8c86921494f649956440bbee6e304aa9437ecc08ce1adf: Status 404 returned error can't find the container with id a520323188f46507dc8c86921494f649956440bbee6e304aa9437ecc08ce1adf
Jul 09 05:03:41.039302 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:41.039285    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 05:03:41.237247 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:41.237208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf" event={"ID":"d70052ea-9c63-4d92-830c-5bfa62236ad5","Type":"ContainerStarted","Data":"a520323188f46507dc8c86921494f649956440bbee6e304aa9437ecc08ce1adf"}
Jul 09 05:03:42.243903 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:42.243870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf" event={"ID":"d70052ea-9c63-4d92-830c-5bfa62236ad5","Type":"ContainerStarted","Data":"cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522"}
Jul 09 05:03:42.244293 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:42.243938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:42.260459 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:42.260409    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf" podStartSLOduration=2.693404733 podStartE2EDuration="3.260392561s" totalImagesPullingTime="566.987828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:03:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:03:42.258843903 +0000 UTC m=+1889.419264422" watchObservedRunningTime="2026-07-09 05:03:42.260392561 +0000 UTC m=+1889.420813137"
Jul 09 05:03:48.254999 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.254962    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:03:48.461782 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.461744    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"]
Jul 09 05:03:48.465393 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.465368    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.467973 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.467910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-64ed88-serving-cert\""
Jul 09 05:03:48.474741 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.474701    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"]
Jul 09 05:03:48.558036 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.557952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83b869e-fe2f-4e16-ab57-686077502b9b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.558036 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.557992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d83b869e-fe2f-4e16-ab57-686077502b9b-maas-api-tls\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.558036 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.558018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd4bk\" (UniqueName: \"kubernetes.io/projected/d83b869e-fe2f-4e16-ab57-686077502b9b-kube-api-access-qd4bk\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.658857 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.658821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83b869e-fe2f-4e16-ab57-686077502b9b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.658857 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.658861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d83b869e-fe2f-4e16-ab57-686077502b9b-maas-api-tls\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.659092 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.658895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd4bk\" (UniqueName: \"kubernetes.io/projected/d83b869e-fe2f-4e16-ab57-686077502b9b-kube-api-access-qd4bk\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.659502 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.659472    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83b869e-fe2f-4e16-ab57-686077502b9b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.661250 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.661230    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d83b869e-fe2f-4e16-ab57-686077502b9b-maas-api-tls\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.668893 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.668864    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd4bk\" (UniqueName: \"kubernetes.io/projected/d83b869e-fe2f-4e16-ab57-686077502b9b-kube-api-access-qd4bk\") pod \"maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.783036 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.783006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:48.923739 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:48.923707    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"]
Jul 09 05:03:48.925607 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:03:48.925570    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83b869e_fe2f_4e16_ab57_686077502b9b.slice/crio-65106f3506c5c86cd8fd7e1dfe1c65598e8dd0b37b65782256b93cfb1ec2c082 WatchSource:0}: Error finding container 65106f3506c5c86cd8fd7e1dfe1c65598e8dd0b37b65782256b93cfb1ec2c082: Status 404 returned error can't find the container with id 65106f3506c5c86cd8fd7e1dfe1c65598e8dd0b37b65782256b93cfb1ec2c082
Jul 09 05:03:49.285543 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:49.285503    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7" event={"ID":"d83b869e-fe2f-4e16-ab57-686077502b9b","Type":"ContainerStarted","Data":"65106f3506c5c86cd8fd7e1dfe1c65598e8dd0b37b65782256b93cfb1ec2c082"}
Jul 09 05:03:50.292119 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:50.292082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7" event={"ID":"d83b869e-fe2f-4e16-ab57-686077502b9b","Type":"ContainerStarted","Data":"01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8"}
Jul 09 05:03:50.292620 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:50.292195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:03:50.310307 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:50.310258    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7" podStartSLOduration=1.923431197 podStartE2EDuration="2.310239346s" totalImagesPullingTime="386.808149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:03:50.308942315 +0000 UTC m=+1897.469362850" watchObservedRunningTime="2026-07-09 05:03:50.310239346 +0000 UTC m=+1897.470659866"
Jul 09 05:03:56.305509 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:03:56.305476    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:04:05.149097 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.149065    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"]
Jul 09 05:04:05.152571 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.152554    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.154998 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.154968    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-61a9e8\"/\"kube-root-ca.crt\""
Jul 09 05:04:05.155120 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.154985    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-61a9e8\"/\"openshift-service-ca.crt\""
Jul 09 05:04:05.156071 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.156052    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-61a9e8\"/\"default-dockercfg-rrrmb\""
Jul 09 05:04:05.156184 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.156071    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-61a9e8\"/\"test-model-61a9e8-kserve-self-signed-certs\""
Jul 09 05:04:05.160122 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.160100    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"]
Jul 09 05:04:05.308568 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.308525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-model-cache\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.308915 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.308889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-dshm\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.309065 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.308939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tls-certs\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.309065 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.308984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn7p2\" (UniqueName: \"kubernetes.io/projected/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-kube-api-access-vn7p2\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.309187 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.309084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-home\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.309187 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.309138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tmp-dir\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410049 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.409956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-home\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410049 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tmp-dir\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410227 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-model-cache\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410227 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-dshm\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410227 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tls-certs\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410341 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn7p2\" (UniqueName: \"kubernetes.io/projected/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-kube-api-access-vn7p2\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410398 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-home\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410433 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410408    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tmp-dir\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.410484 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.410464    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-model-cache\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.412586 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.412558    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-dshm\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.412847 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.412826    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tls-certs\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.418230 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.418205    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn7p2\" (UniqueName: \"kubernetes.io/projected/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-kube-api-access-vn7p2\") pod \"test-model-61a9e8-kserve-79c54f5fc7-v697z\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") " pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.463902 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.463864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:05.602988 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:05.602963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"]
Jul 09 05:04:05.604450 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:04:05.604424    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0a423ed_d4e4_4fce_ae10_8003c3ebbdc7.slice/crio-4ad1637b9e016bcda9248571678eae26ed8d0a7dc1287a6e0f0e8fbcb45dae86 WatchSource:0}: Error finding container 4ad1637b9e016bcda9248571678eae26ed8d0a7dc1287a6e0f0e8fbcb45dae86: Status 404 returned error can't find the container with id 4ad1637b9e016bcda9248571678eae26ed8d0a7dc1287a6e0f0e8fbcb45dae86
Jul 09 05:04:06.384294 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:06.384255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z" event={"ID":"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7","Type":"ContainerStarted","Data":"08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120"}
Jul 09 05:04:06.384294 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:06.384296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z" event={"ID":"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7","Type":"ContainerStarted","Data":"4ad1637b9e016bcda9248571678eae26ed8d0a7dc1287a6e0f0e8fbcb45dae86"}
Jul 09 05:04:06.400637 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:06.400581    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z" podStartSLOduration=1.400565775 podStartE2EDuration="1.400565775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:04:06.399364827 +0000 UTC m=+1913.559785347" watchObservedRunningTime="2026-07-09 05:04:06.400565775 +0000 UTC m=+1913.560986294"
Jul 09 05:04:15.464612 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:15.464574    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:15.465145 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:15.464682    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:15.477850 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:15.477820    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:04:16.449900 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:04:16.449865    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:05:06.837848 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:06.837753    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"]
Jul 09 05:05:08.779810 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:08.779776    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"]
Jul 09 05:05:08.780307 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:08.780053    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf" podUID="d70052ea-9c63-4d92-830c-5bfa62236ad5" containerName="maas-api" containerID="cri-o://cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522" gracePeriod=30
Jul 09 05:05:09.231212 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.231186    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:05:09.280121 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.280082    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqnpf\" (UniqueName: \"kubernetes.io/projected/d70052ea-9c63-4d92-830c-5bfa62236ad5-kube-api-access-zqnpf\") pod \"d70052ea-9c63-4d92-830c-5bfa62236ad5\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") "
Jul 09 05:05:09.280299 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.280136    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls\") pod \"d70052ea-9c63-4d92-830c-5bfa62236ad5\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") "
Jul 09 05:05:09.280299 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.280161    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70052ea-9c63-4d92-830c-5bfa62236ad5-openshift-service-ca\") pod \"d70052ea-9c63-4d92-830c-5bfa62236ad5\" (UID: \"d70052ea-9c63-4d92-830c-5bfa62236ad5\") "
Jul 09 05:05:09.280575 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.280547    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d70052ea-9c63-4d92-830c-5bfa62236ad5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d70052ea-9c63-4d92-830c-5bfa62236ad5" (UID: "d70052ea-9c63-4d92-830c-5bfa62236ad5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:05:09.282195 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.282168    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d70052ea-9c63-4d92-830c-5bfa62236ad5" (UID: "d70052ea-9c63-4d92-830c-5bfa62236ad5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:05:09.282303 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.282213    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70052ea-9c63-4d92-830c-5bfa62236ad5-kube-api-access-zqnpf" (OuterVolumeSpecName: "kube-api-access-zqnpf") pod "d70052ea-9c63-4d92-830c-5bfa62236ad5" (UID: "d70052ea-9c63-4d92-830c-5bfa62236ad5"). InnerVolumeSpecName "kube-api-access-zqnpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:05:09.381764 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.381672    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqnpf\" (UniqueName: \"kubernetes.io/projected/d70052ea-9c63-4d92-830c-5bfa62236ad5-kube-api-access-zqnpf\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:09.381764 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.381704    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70052ea-9c63-4d92-830c-5bfa62236ad5-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:09.381764 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.381714    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70052ea-9c63-4d92-830c-5bfa62236ad5-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:09.722271 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.722184    2563 generic.go:356] "Generic (PLEG): container finished" podID="d70052ea-9c63-4d92-830c-5bfa62236ad5" containerID="cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522" exitCode=0
Jul 09 05:05:09.722271 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.722226    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"
Jul 09 05:05:09.722520 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.722272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf" event={"ID":"d70052ea-9c63-4d92-830c-5bfa62236ad5","Type":"ContainerDied","Data":"cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522"}
Jul 09 05:05:09.722520 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.722325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf" event={"ID":"d70052ea-9c63-4d92-830c-5bfa62236ad5","Type":"ContainerDied","Data":"a520323188f46507dc8c86921494f649956440bbee6e304aa9437ecc08ce1adf"}
Jul 09 05:05:09.722520 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.722354    2563 scope.go:117] "RemoveContainer" containerID="cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522"
Jul 09 05:05:09.731457 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.731439    2563 scope.go:117] "RemoveContainer" containerID="cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522"
Jul 09 05:05:09.731721 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:05:09.731703    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522\": container with ID starting with cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522 not found: ID does not exist" containerID="cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522"
Jul 09 05:05:09.731779 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.731732    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522"} err="failed to get container status \"cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522\": rpc error: code = NotFound desc = could not find container \"cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522\": container with ID starting with cb06b47290de679dcdc1fced9aaf75f84fd39c9652103b5a0a8865b864bd2522 not found: ID does not exist"
Jul 09 05:05:09.743385 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.743358    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"]
Jul 09 05:05:09.746907 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:09.746884    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-61a9e8-b76bf768f-z69kf"]
Jul 09 05:05:10.704840 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:10.704805    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d70052ea-9c63-4d92-830c-5bfa62236ad5" path="/var/lib/kubelet/pods/d70052ea-9c63-4d92-830c-5bfa62236ad5/volumes"
Jul 09 05:05:21.859100 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:21.859033    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z" podUID="c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" containerName="main" containerID="cri-o://08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120" gracePeriod=45
Jul 09 05:05:22.113406 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.113344    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:05:22.201959 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.201923    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tmp-dir\") pod \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") "
Jul 09 05:05:22.202155 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.201973    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tls-certs\") pod \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") "
Jul 09 05:05:22.202155 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202018    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-home\") pod \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") "
Jul 09 05:05:22.202155 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202051    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-model-cache\") pod \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") "
Jul 09 05:05:22.202155 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-dshm\") pod \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") "
Jul 09 05:05:22.202155 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202139    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn7p2\" (UniqueName: \"kubernetes.io/projected/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-kube-api-access-vn7p2\") pod \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\" (UID: \"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7\") "
Jul 09 05:05:22.202393 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202235    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" (UID: "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 05:05:22.202393 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202281    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-home" (OuterVolumeSpecName: "home") pod "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" (UID: "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 05:05:22.202393 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202346    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-model-cache" (OuterVolumeSpecName: "model-cache") pod "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" (UID: "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 05:05:22.202552 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202479    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tmp-dir\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:22.202552 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202497    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-home\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:22.202552 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.202509    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-model-cache\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:22.204296 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.204275    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-dshm" (OuterVolumeSpecName: "dshm") pod "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" (UID: "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 05:05:22.204368 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.204331    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" (UID: "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:05:22.204464 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.204440    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-kube-api-access-vn7p2" (OuterVolumeSpecName: "kube-api-access-vn7p2") pod "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" (UID: "c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7"). InnerVolumeSpecName "kube-api-access-vn7p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:05:22.303047 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.303006    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-tls-certs\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:22.303047 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.303041    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-dshm\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:22.303047 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.303054    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn7p2\" (UniqueName: \"kubernetes.io/projected/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7-kube-api-access-vn7p2\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:22.792125 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.792093    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" containerID="08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120" exitCode=0
Jul 09 05:05:22.792300 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.792137    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"
Jul 09 05:05:22.792300 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.792184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z" event={"ID":"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7","Type":"ContainerDied","Data":"08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120"}
Jul 09 05:05:22.792300 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.792248    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z" event={"ID":"c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7","Type":"ContainerDied","Data":"4ad1637b9e016bcda9248571678eae26ed8d0a7dc1287a6e0f0e8fbcb45dae86"}
Jul 09 05:05:22.792300 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.792268    2563 scope.go:117] "RemoveContainer" containerID="08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120"
Jul 09 05:05:22.801164 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.801136    2563 scope.go:117] "RemoveContainer" containerID="08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120"
Jul 09 05:05:22.801423 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:05:22.801402    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120\": container with ID starting with 08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120 not found: ID does not exist" containerID="08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120"
Jul 09 05:05:22.801474 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.801432    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120"} err="failed to get container status \"08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120\": rpc error: code = NotFound desc = could not find container \"08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120\": container with ID starting with 08247e9961aed18ae20aee7e3de462a72a5a7f21f602570dbeb50eeeb4c9b120 not found: ID does not exist"
Jul 09 05:05:22.807998 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.807971    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"]
Jul 09 05:05:22.809993 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:22.809971    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-61a9e8/test-model-61a9e8-kserve-79c54f5fc7-v697z"]
Jul 09 05:05:24.702865 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:24.702832    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" path="/var/lib/kubelet/pods/c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7/volumes"
Jul 09 05:05:51.516916 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.516878    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"]
Jul 09 05:05:51.517524 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.517146    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7" podUID="d83b869e-fe2f-4e16-ab57-686077502b9b" containerName="maas-api" containerID="cri-o://01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8" gracePeriod=30
Jul 09 05:05:51.768411 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.768341    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:05:51.943081 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.943037    2563 generic.go:356] "Generic (PLEG): container finished" podID="d83b869e-fe2f-4e16-ab57-686077502b9b" containerID="01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8" exitCode=0
Jul 09 05:05:51.943260 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.943088    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"
Jul 09 05:05:51.943260 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.943119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7" event={"ID":"d83b869e-fe2f-4e16-ab57-686077502b9b","Type":"ContainerDied","Data":"01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8"}
Jul 09 05:05:51.943260 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.943179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7" event={"ID":"d83b869e-fe2f-4e16-ab57-686077502b9b","Type":"ContainerDied","Data":"65106f3506c5c86cd8fd7e1dfe1c65598e8dd0b37b65782256b93cfb1ec2c082"}
Jul 09 05:05:51.943260 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.943201    2563 scope.go:117] "RemoveContainer" containerID="01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8"
Jul 09 05:05:51.952104 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.952084    2563 scope.go:117] "RemoveContainer" containerID="01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8"
Jul 09 05:05:51.952439 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:05:51.952420    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8\": container with ID starting with 01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8 not found: ID does not exist" containerID="01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8"
Jul 09 05:05:51.952498 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.952450    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8"} err="failed to get container status \"01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8\": rpc error: code = NotFound desc = could not find container \"01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8\": container with ID starting with 01ebbe67e0b10ae4dd53acc09a5327bff62ce64255f9ef2ed7e2784e14a09ae8 not found: ID does not exist"
Jul 09 05:05:51.960773 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.960744    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83b869e-fe2f-4e16-ab57-686077502b9b-openshift-service-ca\") pod \"d83b869e-fe2f-4e16-ab57-686077502b9b\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") "
Jul 09 05:05:51.960926 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.960812    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d83b869e-fe2f-4e16-ab57-686077502b9b-maas-api-tls\") pod \"d83b869e-fe2f-4e16-ab57-686077502b9b\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") "
Jul 09 05:05:51.960926 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.960865    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd4bk\" (UniqueName: \"kubernetes.io/projected/d83b869e-fe2f-4e16-ab57-686077502b9b-kube-api-access-qd4bk\") pod \"d83b869e-fe2f-4e16-ab57-686077502b9b\" (UID: \"d83b869e-fe2f-4e16-ab57-686077502b9b\") "
Jul 09 05:05:51.961105 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.961083    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83b869e-fe2f-4e16-ab57-686077502b9b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d83b869e-fe2f-4e16-ab57-686077502b9b" (UID: "d83b869e-fe2f-4e16-ab57-686077502b9b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:05:51.963028 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.963001    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83b869e-fe2f-4e16-ab57-686077502b9b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d83b869e-fe2f-4e16-ab57-686077502b9b" (UID: "d83b869e-fe2f-4e16-ab57-686077502b9b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:05:51.963149 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:51.963002    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83b869e-fe2f-4e16-ab57-686077502b9b-kube-api-access-qd4bk" (OuterVolumeSpecName: "kube-api-access-qd4bk") pod "d83b869e-fe2f-4e16-ab57-686077502b9b" (UID: "d83b869e-fe2f-4e16-ab57-686077502b9b"). InnerVolumeSpecName "kube-api-access-qd4bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:05:52.061551 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:52.061458    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d83b869e-fe2f-4e16-ab57-686077502b9b-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:52.061551 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:52.061493    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd4bk\" (UniqueName: \"kubernetes.io/projected/d83b869e-fe2f-4e16-ab57-686077502b9b-kube-api-access-qd4bk\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:52.061551 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:52.061504    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83b869e-fe2f-4e16-ab57-686077502b9b-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:05:52.265364 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:52.265324    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"]
Jul 09 05:05:52.271403 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:52.271362    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-64ed88-6dcb496f4c-6trt7"]
Jul 09 05:05:52.701501 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:05:52.701462    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83b869e-fe2f-4e16-ab57-686077502b9b" path="/var/lib/kubelet/pods/d83b869e-fe2f-4e16-ab57-686077502b9b/volumes"
Jul 09 05:06:01.672849 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.672810    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"]
Jul 09 05:06:01.673349 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673321    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83b869e-fe2f-4e16-ab57-686077502b9b" containerName="maas-api"
Jul 09 05:06:01.673349 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673341    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83b869e-fe2f-4e16-ab57-686077502b9b" containerName="maas-api"
Jul 09 05:06:01.673472 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" containerName="main"
Jul 09 05:06:01.673472 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673365    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" containerName="main"
Jul 09 05:06:01.673472 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673403    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70052ea-9c63-4d92-830c-5bfa62236ad5" containerName="maas-api"
Jul 09 05:06:01.673472 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673412    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70052ea-9c63-4d92-830c-5bfa62236ad5" containerName="maas-api"
Jul 09 05:06:01.673714 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673503    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70052ea-9c63-4d92-830c-5bfa62236ad5" containerName="maas-api"
Jul 09 05:06:01.673714 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673518    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a423ed-d4e4-4fce-ae10-8003c3ebbdc7" containerName="main"
Jul 09 05:06:01.673714 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.673529    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83b869e-fe2f-4e16-ab57-686077502b9b" containerName="maas-api"
Jul 09 05:06:01.678187 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.678155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.680683 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.680662    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ad2943-serving-cert\""
Jul 09 05:06:01.691064 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.691033    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"]
Jul 09 05:06:01.745140 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.745095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7n4v\" (UniqueName: \"kubernetes.io/projected/a5144108-b37d-4248-8578-55576329500b-kube-api-access-x7n4v\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.745355 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.745156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5144108-b37d-4248-8578-55576329500b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.745355 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.745308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.846074 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.846033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.846283 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.846090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7n4v\" (UniqueName: \"kubernetes.io/projected/a5144108-b37d-4248-8578-55576329500b-kube-api-access-x7n4v\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.846283 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.846127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5144108-b37d-4248-8578-55576329500b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.846283 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:01.846178    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-serving-cert: secret "maas-api-e2e-api-a-ad2943-serving-cert" not found
Jul 09 05:06:01.846283 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:01.846241    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls podName:a5144108-b37d-4248-8578-55576329500b nodeName:}" failed. No retries permitted until 2026-07-09 05:06:02.346226416 +0000 UTC m=+2029.506646914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls") pod "maas-api-e2e-api-a-ad2943-868649f555-xx8nm" (UID: "a5144108-b37d-4248-8578-55576329500b") : secret "maas-api-e2e-api-a-ad2943-serving-cert" not found
Jul 09 05:06:01.846802 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.846785    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5144108-b37d-4248-8578-55576329500b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:01.855143 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:01.855119    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7n4v\" (UniqueName: \"kubernetes.io/projected/a5144108-b37d-4248-8578-55576329500b-kube-api-access-x7n4v\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:02.350763 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:02.350720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:02.353156 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:02.353131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls\") pod \"maas-api-e2e-api-a-ad2943-868649f555-xx8nm\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:02.589501 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:02.589468    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:02.731906 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:02.731879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"]
Jul 09 05:06:02.734140 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:06:02.734109    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5144108_b37d_4248_8578_55576329500b.slice/crio-dbea700dec476880e5107c1c76f227671e4258225d16034492a9a78ecc5fe7e2 WatchSource:0}: Error finding container dbea700dec476880e5107c1c76f227671e4258225d16034492a9a78ecc5fe7e2: Status 404 returned error can't find the container with id dbea700dec476880e5107c1c76f227671e4258225d16034492a9a78ecc5fe7e2
Jul 09 05:06:03.000932 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:03.000898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm" event={"ID":"a5144108-b37d-4248-8578-55576329500b","Type":"ContainerStarted","Data":"dbea700dec476880e5107c1c76f227671e4258225d16034492a9a78ecc5fe7e2"}
Jul 09 05:06:04.007216 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:04.007180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm" event={"ID":"a5144108-b37d-4248-8578-55576329500b","Type":"ContainerStarted","Data":"f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3"}
Jul 09 05:06:04.007634 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:04.007244    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:04.023086 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:04.023044    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm" podStartSLOduration=2.497574054 podStartE2EDuration="3.023027538s" totalImagesPullingTime="525.453484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:06:04.021760769 +0000 UTC m=+2031.182181289" watchObservedRunningTime="2026-07-09 05:06:04.023027538 +0000 UTC m=+2031.183448059"
Jul 09 05:06:10.005100 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.005059    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"]
Jul 09 05:06:10.008844 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.008818    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.011616 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.011594    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9ad9dc-serving-cert\""
Jul 09 05:06:10.018333 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.018310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:10.022509 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.022479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"]
Jul 09 05:06:10.122401 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.122354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de77ef3-211c-4edb-a22b-145e0023a5fd-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.122401 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.122395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ctk\" (UniqueName: \"kubernetes.io/projected/6de77ef3-211c-4edb-a22b-145e0023a5fd-kube-api-access-54ctk\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.122680 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.122467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.223192 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.223154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de77ef3-211c-4edb-a22b-145e0023a5fd-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.223192 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.223190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ctk\" (UniqueName: \"kubernetes.io/projected/6de77ef3-211c-4edb-a22b-145e0023a5fd-kube-api-access-54ctk\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.223454 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.223240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.223454 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:10.223356    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-serving-cert: secret "maas-api-e2e-api-b-9ad9dc-serving-cert" not found
Jul 09 05:06:10.223454 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:10.223444    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls podName:6de77ef3-211c-4edb-a22b-145e0023a5fd nodeName:}" failed. No retries permitted until 2026-07-09 05:06:10.72342034 +0000 UTC m=+2037.883840856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls") pod "maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd" (UID: "6de77ef3-211c-4edb-a22b-145e0023a5fd") : secret "maas-api-e2e-api-b-9ad9dc-serving-cert" not found
Jul 09 05:06:10.223872 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.223849    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de77ef3-211c-4edb-a22b-145e0023a5fd-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.234673 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.234622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ctk\" (UniqueName: \"kubernetes.io/projected/6de77ef3-211c-4edb-a22b-145e0023a5fd-kube-api-access-54ctk\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.727910 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.727874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.730307 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.730281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls\") pod \"maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:10.923945 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:10.923904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:11.063912 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:11.063884    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"]
Jul 09 05:06:11.066137 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:06:11.066106    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de77ef3_211c_4edb_a22b_145e0023a5fd.slice/crio-3ae15ad5241dec2539366003f049fbd009f11974f83c7ad63bf3e3f230dceecf WatchSource:0}: Error finding container 3ae15ad5241dec2539366003f049fbd009f11974f83c7ad63bf3e3f230dceecf: Status 404 returned error can't find the container with id 3ae15ad5241dec2539366003f049fbd009f11974f83c7ad63bf3e3f230dceecf
Jul 09 05:06:12.050621 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:12.050582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd" event={"ID":"6de77ef3-211c-4edb-a22b-145e0023a5fd","Type":"ContainerStarted","Data":"b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f"}
Jul 09 05:06:12.050830 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:12.050664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd" event={"ID":"6de77ef3-211c-4edb-a22b-145e0023a5fd","Type":"ContainerStarted","Data":"3ae15ad5241dec2539366003f049fbd009f11974f83c7ad63bf3e3f230dceecf"}
Jul 09 05:06:12.050830 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:12.050693    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:12.066836 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:12.066787    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd" podStartSLOduration=2.687041816 podStartE2EDuration="3.066769534s" totalImagesPullingTime="379.727718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:06:12.065352427 +0000 UTC m=+2039.225772947" watchObservedRunningTime="2026-07-09 05:06:12.066769534 +0000 UTC m=+2039.227190053"
Jul 09 05:06:18.060996 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:18.060966    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:23.281361 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.281315    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"]
Jul 09 05:06:23.282038 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.281573    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm" podUID="a5144108-b37d-4248-8578-55576329500b" containerName="maas-api" containerID="cri-o://f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3" gracePeriod=30
Jul 09 05:06:23.532157 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.532091    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:23.640597 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.640558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7n4v\" (UniqueName: \"kubernetes.io/projected/a5144108-b37d-4248-8578-55576329500b-kube-api-access-x7n4v\") pod \"a5144108-b37d-4248-8578-55576329500b\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") "
Jul 09 05:06:23.640823 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.640612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5144108-b37d-4248-8578-55576329500b-openshift-service-ca\") pod \"a5144108-b37d-4248-8578-55576329500b\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") "
Jul 09 05:06:23.640823 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.640740    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls\") pod \"a5144108-b37d-4248-8578-55576329500b\" (UID: \"a5144108-b37d-4248-8578-55576329500b\") "
Jul 09 05:06:23.640999 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.640974    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5144108-b37d-4248-8578-55576329500b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5144108-b37d-4248-8578-55576329500b" (UID: "a5144108-b37d-4248-8578-55576329500b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:06:23.642766 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.642740    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5144108-b37d-4248-8578-55576329500b" (UID: "a5144108-b37d-4248-8578-55576329500b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:06:23.642881 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.642788    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5144108-b37d-4248-8578-55576329500b-kube-api-access-x7n4v" (OuterVolumeSpecName: "kube-api-access-x7n4v") pod "a5144108-b37d-4248-8578-55576329500b" (UID: "a5144108-b37d-4248-8578-55576329500b"). InnerVolumeSpecName "kube-api-access-x7n4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:06:23.741606 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.741568    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7n4v\" (UniqueName: \"kubernetes.io/projected/a5144108-b37d-4248-8578-55576329500b-kube-api-access-x7n4v\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:06:23.741606 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.741600    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5144108-b37d-4248-8578-55576329500b-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:06:23.741606 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:23.741610    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5144108-b37d-4248-8578-55576329500b-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:06:24.122517 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.122481    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5144108-b37d-4248-8578-55576329500b" containerID="f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3" exitCode=0
Jul 09 05:06:24.122710 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.122523    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"
Jul 09 05:06:24.122710 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.122568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm" event={"ID":"a5144108-b37d-4248-8578-55576329500b","Type":"ContainerDied","Data":"f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3"}
Jul 09 05:06:24.122710 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.122616    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm" event={"ID":"a5144108-b37d-4248-8578-55576329500b","Type":"ContainerDied","Data":"dbea700dec476880e5107c1c76f227671e4258225d16034492a9a78ecc5fe7e2"}
Jul 09 05:06:24.122710 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.122655    2563 scope.go:117] "RemoveContainer" containerID="f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3"
Jul 09 05:06:24.131920 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.131904    2563 scope.go:117] "RemoveContainer" containerID="f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3"
Jul 09 05:06:24.132185 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:24.132166    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3\": container with ID starting with f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3 not found: ID does not exist" containerID="f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3"
Jul 09 05:06:24.132255 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.132193    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3"} err="failed to get container status \"f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3\": rpc error: code = NotFound desc = could not find container \"f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3\": container with ID starting with f8ce1960e46dcdbdc54e1bb1b6205e4e5823f310f4d49373cab26205a36592a3 not found: ID does not exist"
Jul 09 05:06:24.143153 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.143128    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"]
Jul 09 05:06:24.148821 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.148798    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ad2943-868649f555-xx8nm"]
Jul 09 05:06:24.702126 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:24.702093    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5144108-b37d-4248-8578-55576329500b" path="/var/lib/kubelet/pods/a5144108-b37d-4248-8578-55576329500b/volumes"
Jul 09 05:06:29.832600 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:29.832535    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"]
Jul 09 05:06:29.833032 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:29.832841    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd" podUID="6de77ef3-211c-4edb-a22b-145e0023a5fd" containerName="maas-api" containerID="cri-o://b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f" gracePeriod=30
Jul 09 05:06:30.102156 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.102129    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:30.155446 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.155415    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de77ef3-211c-4edb-a22b-145e0023a5fd" containerID="b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f" exitCode=0
Jul 09 05:06:30.155628 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.155463    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"
Jul 09 05:06:30.155628 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.155508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd" event={"ID":"6de77ef3-211c-4edb-a22b-145e0023a5fd","Type":"ContainerDied","Data":"b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f"}
Jul 09 05:06:30.155628 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.155555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd" event={"ID":"6de77ef3-211c-4edb-a22b-145e0023a5fd","Type":"ContainerDied","Data":"3ae15ad5241dec2539366003f049fbd009f11974f83c7ad63bf3e3f230dceecf"}
Jul 09 05:06:30.155628 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.155576    2563 scope.go:117] "RemoveContainer" containerID="b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f"
Jul 09 05:06:30.163793 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.163776    2563 scope.go:117] "RemoveContainer" containerID="b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f"
Jul 09 05:06:30.164036 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:30.164019    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f\": container with ID starting with b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f not found: ID does not exist" containerID="b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f"
Jul 09 05:06:30.164081 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.164047    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f"} err="failed to get container status \"b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f\": rpc error: code = NotFound desc = could not find container \"b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f\": container with ID starting with b7c3bcc34114a5e1fde00ecb6e4edaa4bf04ed5878aad3ca13bc56c2e24a429f not found: ID does not exist"
Jul 09 05:06:30.204369 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.204338    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de77ef3-211c-4edb-a22b-145e0023a5fd-openshift-service-ca\") pod \"6de77ef3-211c-4edb-a22b-145e0023a5fd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") "
Jul 09 05:06:30.204369 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.204369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls\") pod \"6de77ef3-211c-4edb-a22b-145e0023a5fd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") "
Jul 09 05:06:30.204628 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.204446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54ctk\" (UniqueName: \"kubernetes.io/projected/6de77ef3-211c-4edb-a22b-145e0023a5fd-kube-api-access-54ctk\") pod \"6de77ef3-211c-4edb-a22b-145e0023a5fd\" (UID: \"6de77ef3-211c-4edb-a22b-145e0023a5fd\") "
Jul 09 05:06:30.204745 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.204722    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de77ef3-211c-4edb-a22b-145e0023a5fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6de77ef3-211c-4edb-a22b-145e0023a5fd" (UID: "6de77ef3-211c-4edb-a22b-145e0023a5fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:06:30.206552 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.206526    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6de77ef3-211c-4edb-a22b-145e0023a5fd" (UID: "6de77ef3-211c-4edb-a22b-145e0023a5fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:06:30.206677 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.206531    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de77ef3-211c-4edb-a22b-145e0023a5fd-kube-api-access-54ctk" (OuterVolumeSpecName: "kube-api-access-54ctk") pod "6de77ef3-211c-4edb-a22b-145e0023a5fd" (UID: "6de77ef3-211c-4edb-a22b-145e0023a5fd"). InnerVolumeSpecName "kube-api-access-54ctk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:06:30.305561 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.305527    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54ctk\" (UniqueName: \"kubernetes.io/projected/6de77ef3-211c-4edb-a22b-145e0023a5fd-kube-api-access-54ctk\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:06:30.305561 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.305553    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de77ef3-211c-4edb-a22b-145e0023a5fd-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:06:30.305561 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.305563    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de77ef3-211c-4edb-a22b-145e0023a5fd-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:06:30.478137 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.477998    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"]
Jul 09 05:06:30.480348 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.480319    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ad9dc-bb7b48d97-prdtd"]
Jul 09 05:06:30.701920 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:30.701887    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de77ef3-211c-4edb-a22b-145e0023a5fd" path="/var/lib/kubelet/pods/6de77ef3-211c-4edb-a22b-145e0023a5fd/volumes"
Jul 09 05:06:38.852014 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.851924    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"]
Jul 09 05:06:38.852459 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.852326    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5144108-b37d-4248-8578-55576329500b" containerName="maas-api"
Jul 09 05:06:38.852459 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.852340    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5144108-b37d-4248-8578-55576329500b" containerName="maas-api"
Jul 09 05:06:38.852459 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.852349    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de77ef3-211c-4edb-a22b-145e0023a5fd" containerName="maas-api"
Jul 09 05:06:38.852459 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.852354    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de77ef3-211c-4edb-a22b-145e0023a5fd" containerName="maas-api"
Jul 09 05:06:38.852459 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.852409    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5144108-b37d-4248-8578-55576329500b" containerName="maas-api"
Jul 09 05:06:38.852459 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.852416    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de77ef3-211c-4edb-a22b-145e0023a5fd" containerName="maas-api"
Jul 09 05:06:38.856761 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.856738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:38.862516 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.862491    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f932f4-serving-cert\""
Jul 09 05:06:38.873769 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.873737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"]
Jul 09 05:06:38.982662 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.982611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b24b8a8-be21-4c5d-9365-383b486cc739-maas-api-tls\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:38.982662 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.982656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpq2j\" (UniqueName: \"kubernetes.io/projected/2b24b8a8-be21-4c5d-9365-383b486cc739-kube-api-access-dpq2j\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:38.982881 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:38.982713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b24b8a8-be21-4c5d-9365-383b486cc739-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.083156 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.083113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b24b8a8-be21-4c5d-9365-383b486cc739-maas-api-tls\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.083156 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.083157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpq2j\" (UniqueName: \"kubernetes.io/projected/2b24b8a8-be21-4c5d-9365-383b486cc739-kube-api-access-dpq2j\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.083372 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.083199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b24b8a8-be21-4c5d-9365-383b486cc739-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.083952 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.083926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b24b8a8-be21-4c5d-9365-383b486cc739-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.085580 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.085561    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b24b8a8-be21-4c5d-9365-383b486cc739-maas-api-tls\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.090986 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.090956    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpq2j\" (UniqueName: \"kubernetes.io/projected/2b24b8a8-be21-4c5d-9365-383b486cc739-kube-api-access-dpq2j\") pod \"maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.167224 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.167121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:39.309000 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:39.308975    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"]
Jul 09 05:06:39.311018 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:06:39.310995    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b24b8a8_be21_4c5d_9365_383b486cc739.slice/crio-d116246dcbe81b66f93a530369706b7c9fc8a019b51e043e5e50681718572d7e WatchSource:0}: Error finding container d116246dcbe81b66f93a530369706b7c9fc8a019b51e043e5e50681718572d7e: Status 404 returned error can't find the container with id d116246dcbe81b66f93a530369706b7c9fc8a019b51e043e5e50681718572d7e
Jul 09 05:06:40.212337 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:40.212298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f" event={"ID":"2b24b8a8-be21-4c5d-9365-383b486cc739","Type":"ContainerStarted","Data":"d116246dcbe81b66f93a530369706b7c9fc8a019b51e043e5e50681718572d7e"}
Jul 09 05:06:41.218660 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:41.218618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f" event={"ID":"2b24b8a8-be21-4c5d-9365-383b486cc739","Type":"ContainerStarted","Data":"4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77"}
Jul 09 05:06:41.219043 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:41.218732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:41.236419 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:41.236372    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f" podStartSLOduration=2.173343177 podStartE2EDuration="3.236356316s" totalImagesPullingTime="1.063013139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:06:41.234473939 +0000 UTC m=+2068.394894452" watchObservedRunningTime="2026-07-09 05:06:41.236356316 +0000 UTC m=+2068.396776835"
Jul 09 05:06:47.230352 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.230324    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:06:47.379580 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.379536    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"]
Jul 09 05:06:47.383554 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.383530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.386412 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.386389    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-33798d-serving-cert\""
Jul 09 05:06:47.399705 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.399674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"]
Jul 09 05:06:47.453121 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.453084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee888906-86b8-47e5-a4df-7c9c72b3c707-openshift-service-ca\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.453121 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.453121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jgnt\" (UniqueName: \"kubernetes.io/projected/ee888906-86b8-47e5-a4df-7c9c72b3c707-kube-api-access-7jgnt\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.453350 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.453145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.553994 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.553895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee888906-86b8-47e5-a4df-7c9c72b3c707-openshift-service-ca\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.553994 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.553940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jgnt\" (UniqueName: \"kubernetes.io/projected/ee888906-86b8-47e5-a4df-7c9c72b3c707-kube-api-access-7jgnt\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.553994 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.553975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.554248 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:47.554119    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-serving-cert: secret "maas-api-e2e-shared-b-33798d-serving-cert" not found
Jul 09 05:06:47.554248 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:06:47.554192    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls podName:ee888906-86b8-47e5-a4df-7c9c72b3c707 nodeName:}" failed. No retries permitted until 2026-07-09 05:06:48.05417029 +0000 UTC m=+2075.214590799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls") pod "maas-api-e2e-shared-b-33798d-7c9c548744-w97kn" (UID: "ee888906-86b8-47e5-a4df-7c9c72b3c707") : secret "maas-api-e2e-shared-b-33798d-serving-cert" not found
Jul 09 05:06:47.554622 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.554602    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee888906-86b8-47e5-a4df-7c9c72b3c707-openshift-service-ca\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:47.564550 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:47.564513    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jgnt\" (UniqueName: \"kubernetes.io/projected/ee888906-86b8-47e5-a4df-7c9c72b3c707-kube-api-access-7jgnt\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:48.058317 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:48.058276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:48.060829 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:48.060794    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls\") pod \"maas-api-e2e-shared-b-33798d-7c9c548744-w97kn\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:48.294269 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:48.294231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:48.432914 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:48.432890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"]
Jul 09 05:06:48.434715 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:06:48.434684    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee888906_86b8_47e5_a4df_7c9c72b3c707.slice/crio-836605fa035accc918b182360be7c168d5ec33eec7eb101449567eb0d3fd384c WatchSource:0}: Error finding container 836605fa035accc918b182360be7c168d5ec33eec7eb101449567eb0d3fd384c: Status 404 returned error can't find the container with id 836605fa035accc918b182360be7c168d5ec33eec7eb101449567eb0d3fd384c
Jul 09 05:06:49.266635 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:49.266589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn" event={"ID":"ee888906-86b8-47e5-a4df-7c9c72b3c707","Type":"ContainerStarted","Data":"caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b"}
Jul 09 05:06:49.266864 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:49.266701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn" event={"ID":"ee888906-86b8-47e5-a4df-7c9c72b3c707","Type":"ContainerStarted","Data":"836605fa035accc918b182360be7c168d5ec33eec7eb101449567eb0d3fd384c"}
Jul 09 05:06:49.266864 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:49.266732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:06:49.287295 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:49.287237    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn" podStartSLOduration=1.921464837 podStartE2EDuration="2.287218346s" totalImagesPullingTime="365.753509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:06:49.286462376 +0000 UTC m=+2076.446882899" watchObservedRunningTime="2026-07-09 05:06:49.287218346 +0000 UTC m=+2076.447638867"
Jul 09 05:06:55.278709 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:06:55.278680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:07:13.376928 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:07:13.376816    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 05:07:13.396712 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:07:13.396679    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbmds_cd6926db-2043-40d5-b6db-961112476d84/ovn-acl-logging/0.log"
Jul 09 05:09:57.135759 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.135676    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"]
Jul 09 05:09:57.136413 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.135938    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f" podUID="2b24b8a8-be21-4c5d-9365-383b486cc739" containerName="maas-api" containerID="cri-o://4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77" gracePeriod=30
Jul 09 05:09:57.225631 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.225585    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f" podUID="2b24b8a8-be21-4c5d-9365-383b486cc739" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.52:8443/health\": dial tcp 10.134.0.52:8443: connect: connection refused"
Jul 09 05:09:57.391595 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.391524    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:09:57.518396 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.518357    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b24b8a8-be21-4c5d-9365-383b486cc739-openshift-service-ca\") pod \"2b24b8a8-be21-4c5d-9365-383b486cc739\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") "
Jul 09 05:09:57.518396 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.518396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpq2j\" (UniqueName: \"kubernetes.io/projected/2b24b8a8-be21-4c5d-9365-383b486cc739-kube-api-access-dpq2j\") pod \"2b24b8a8-be21-4c5d-9365-383b486cc739\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") "
Jul 09 05:09:57.518699 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.518467    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b24b8a8-be21-4c5d-9365-383b486cc739-maas-api-tls\") pod \"2b24b8a8-be21-4c5d-9365-383b486cc739\" (UID: \"2b24b8a8-be21-4c5d-9365-383b486cc739\") "
Jul 09 05:09:57.518835 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.518813    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b24b8a8-be21-4c5d-9365-383b486cc739-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b24b8a8-be21-4c5d-9365-383b486cc739" (UID: "2b24b8a8-be21-4c5d-9365-383b486cc739"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:09:57.520559 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.520534    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b24b8a8-be21-4c5d-9365-383b486cc739-kube-api-access-dpq2j" (OuterVolumeSpecName: "kube-api-access-dpq2j") pod "2b24b8a8-be21-4c5d-9365-383b486cc739" (UID: "2b24b8a8-be21-4c5d-9365-383b486cc739"). InnerVolumeSpecName "kube-api-access-dpq2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:09:57.520634 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.520623    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b24b8a8-be21-4c5d-9365-383b486cc739-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b24b8a8-be21-4c5d-9365-383b486cc739" (UID: "2b24b8a8-be21-4c5d-9365-383b486cc739"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:09:57.619934 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.619896    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b24b8a8-be21-4c5d-9365-383b486cc739-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:09:57.619934 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.619928    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpq2j\" (UniqueName: \"kubernetes.io/projected/2b24b8a8-be21-4c5d-9365-383b486cc739-kube-api-access-dpq2j\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:09:57.619934 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:57.619940    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b24b8a8-be21-4c5d-9365-383b486cc739-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:09:58.258172 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.258134    2563 generic.go:356] "Generic (PLEG): container finished" podID="2b24b8a8-be21-4c5d-9365-383b486cc739" containerID="4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77" exitCode=0
Jul 09 05:09:58.258585 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.258179    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"
Jul 09 05:09:58.258585 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.258218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f" event={"ID":"2b24b8a8-be21-4c5d-9365-383b486cc739","Type":"ContainerDied","Data":"4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77"}
Jul 09 05:09:58.258585 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.258272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f" event={"ID":"2b24b8a8-be21-4c5d-9365-383b486cc739","Type":"ContainerDied","Data":"d116246dcbe81b66f93a530369706b7c9fc8a019b51e043e5e50681718572d7e"}
Jul 09 05:09:58.258585 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.258294    2563 scope.go:117] "RemoveContainer" containerID="4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77"
Jul 09 05:09:58.269254 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.269232    2563 scope.go:117] "RemoveContainer" containerID="4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77"
Jul 09 05:09:58.269578 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:09:58.269548    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77\": container with ID starting with 4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77 not found: ID does not exist" containerID="4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77"
Jul 09 05:09:58.269702 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.269584    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77"} err="failed to get container status \"4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77\": rpc error: code = NotFound desc = could not find container \"4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77\": container with ID starting with 4605f42e8510aed3cb536e5814242eef80d27bbfcdffcb425f8238c078f47f77 not found: ID does not exist"
Jul 09 05:09:58.280035 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.279997    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"]
Jul 09 05:09:58.284259 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.284217    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f932f4-866bf9fcbf-zbm2f"]
Jul 09 05:09:58.701894 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:09:58.701814    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b24b8a8-be21-4c5d-9365-383b486cc739" path="/var/lib/kubelet/pods/2b24b8a8-be21-4c5d-9365-383b486cc739/volumes"
Jul 09 05:10:03.853193 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:03.853162    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"]
Jul 09 05:10:03.853843 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:03.853374    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn" podUID="ee888906-86b8-47e5-a4df-7c9c72b3c707" containerName="maas-api" containerID="cri-o://caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b" gracePeriod=30
Jul 09 05:10:04.112244 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.112170    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:10:04.280696 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.280623    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee888906-86b8-47e5-a4df-7c9c72b3c707-openshift-service-ca\") pod \"ee888906-86b8-47e5-a4df-7c9c72b3c707\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") "
Jul 09 05:10:04.280875 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.280814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls\") pod \"ee888906-86b8-47e5-a4df-7c9c72b3c707\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") "
Jul 09 05:10:04.280875 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.280859    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jgnt\" (UniqueName: \"kubernetes.io/projected/ee888906-86b8-47e5-a4df-7c9c72b3c707-kube-api-access-7jgnt\") pod \"ee888906-86b8-47e5-a4df-7c9c72b3c707\" (UID: \"ee888906-86b8-47e5-a4df-7c9c72b3c707\") "
Jul 09 05:10:04.281067 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.280967    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee888906-86b8-47e5-a4df-7c9c72b3c707-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee888906-86b8-47e5-a4df-7c9c72b3c707" (UID: "ee888906-86b8-47e5-a4df-7c9c72b3c707"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 05:10:04.281129 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.281074    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee888906-86b8-47e5-a4df-7c9c72b3c707-openshift-service-ca\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:10:04.282962 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.282936    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee888906-86b8-47e5-a4df-7c9c72b3c707" (UID: "ee888906-86b8-47e5-a4df-7c9c72b3c707"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 05:10:04.283138 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.283119    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee888906-86b8-47e5-a4df-7c9c72b3c707-kube-api-access-7jgnt" (OuterVolumeSpecName: "kube-api-access-7jgnt") pod "ee888906-86b8-47e5-a4df-7c9c72b3c707" (UID: "ee888906-86b8-47e5-a4df-7c9c72b3c707"). InnerVolumeSpecName "kube-api-access-7jgnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 05:10:04.291106 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.291081    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee888906-86b8-47e5-a4df-7c9c72b3c707" containerID="caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b" exitCode=0
Jul 09 05:10:04.291225 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.291125    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"
Jul 09 05:10:04.291225 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.291164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn" event={"ID":"ee888906-86b8-47e5-a4df-7c9c72b3c707","Type":"ContainerDied","Data":"caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b"}
Jul 09 05:10:04.291320 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.291238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn" event={"ID":"ee888906-86b8-47e5-a4df-7c9c72b3c707","Type":"ContainerDied","Data":"836605fa035accc918b182360be7c168d5ec33eec7eb101449567eb0d3fd384c"}
Jul 09 05:10:04.291320 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.291263    2563 scope.go:117] "RemoveContainer" containerID="caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b"
Jul 09 05:10:04.301065 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.301050    2563 scope.go:117] "RemoveContainer" containerID="caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b"
Jul 09 05:10:04.301299 ip-10-0-134-202 kubenswrapper[2563]: E0709 05:10:04.301279    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b\": container with ID starting with caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b not found: ID does not exist" containerID="caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b"
Jul 09 05:10:04.301345 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.301309    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b"} err="failed to get container status \"caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b\": rpc error: code = NotFound desc = could not find container \"caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b\": container with ID starting with caa24c7f8eb5adcfef6e99cf07f432886803633ed5bd0a75bfa03bfe9245c97b not found: ID does not exist"
Jul 09 05:10:04.313768 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.313741    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"]
Jul 09 05:10:04.317294 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.317272    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-33798d-7c9c548744-w97kn"]
Jul 09 05:10:04.381879 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.381785    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jgnt\" (UniqueName: \"kubernetes.io/projected/ee888906-86b8-47e5-a4df-7c9c72b3c707-kube-api-access-7jgnt\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:10:04.381879 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.381815    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee888906-86b8-47e5-a4df-7c9c72b3c707-maas-api-tls\") on node \"ip-10-0-134-202.ec2.internal\" DevicePath \"\""
Jul 09 05:10:04.701736 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:04.701633    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee888906-86b8-47e5-a4df-7c9c72b3c707" path="/var/lib/kubelet/pods/ee888906-86b8-47e5-a4df-7c9c72b3c707/volumes"
Jul 09 05:10:15.234654 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:15.234615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-cqmwf_93053eac-31a5-4383-8f9e-565627f4e01a/copy-manifests/0.log"
Jul 09 05:10:15.246714 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:15.246685    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-cqmwf_93053eac-31a5-4383-8f9e-565627f4e01a/manager/1.log"
Jul 09 05:10:16.130922 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.130892    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs_e18f7959-55de-4dca-a727-1df7ec3fba24/util/0.log"
Jul 09 05:10:16.137211 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.137186    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs_e18f7959-55de-4dca-a727-1df7ec3fba24/pull/0.log"
Jul 09 05:10:16.143661 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.143628    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs_e18f7959-55de-4dca-a727-1df7ec3fba24/extract/0.log"
Jul 09 05:10:16.251855 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.251822    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz_086e009e-0228-41f3-b615-9288907e5e23/util/0.log"
Jul 09 05:10:16.257927 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.257901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz_086e009e-0228-41f3-b615-9288907e5e23/pull/0.log"
Jul 09 05:10:16.264061 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.264036    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz_086e009e-0228-41f3-b615-9288907e5e23/extract/0.log"
Jul 09 05:10:16.373427 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.373396    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65_c30e37e4-b222-4106-acef-b654d94183f6/util/0.log"
Jul 09 05:10:16.380211 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.380182    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65_c30e37e4-b222-4106-acef-b654d94183f6/pull/0.log"
Jul 09 05:10:16.386971 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.386890    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65_c30e37e4-b222-4106-acef-b654d94183f6/extract/0.log"
Jul 09 05:10:16.500011 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.499975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9_496fb746-9237-41c9-8d4d-4bff5ee8d63a/pull/0.log"
Jul 09 05:10:16.506394 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.506362    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9_496fb746-9237-41c9-8d4d-4bff5ee8d63a/extract/0.log"
Jul 09 05:10:16.514161 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:16.514133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9_496fb746-9237-41c9-8d4d-4bff5ee8d63a/util/0.log"
Jul 09 05:10:17.193935 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:17.193900    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qmkm9_16343375-8c73-4daf-8341-e5562a333757/manager/0.log"
Jul 09 05:10:18.086186 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:18.086153    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47bc47d8-9nd5l_adc85dae-c570-4b52-96bf-b0321648ac0e/kube-auth-proxy/0.log"
Jul 09 05:10:19.093320 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:19.093288    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fb9lm_5c557cca-4acb-4a5f-a4a2-93bcc51a647b/main/0.log"
Jul 09 05:10:23.139201 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.139164    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts86v/must-gather-tlsqv"]
Jul 09 05:10:23.139579 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.139500    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b24b8a8-be21-4c5d-9365-383b486cc739" containerName="maas-api"
Jul 09 05:10:23.139579 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.139510    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b24b8a8-be21-4c5d-9365-383b486cc739" containerName="maas-api"
Jul 09 05:10:23.139579 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.139532    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee888906-86b8-47e5-a4df-7c9c72b3c707" containerName="maas-api"
Jul 09 05:10:23.139579 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.139538    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee888906-86b8-47e5-a4df-7c9c72b3c707" containerName="maas-api"
Jul 09 05:10:23.139751 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.139592    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b24b8a8-be21-4c5d-9365-383b486cc739" containerName="maas-api"
Jul 09 05:10:23.139751 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.139601    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee888906-86b8-47e5-a4df-7c9c72b3c707" containerName="maas-api"
Jul 09 05:10:23.142777 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.142760    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.145192 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.145166    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts86v\"/\"kube-root-ca.crt\""
Jul 09 05:10:23.145326 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.145207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ts86v\"/\"default-dockercfg-lmq77\""
Jul 09 05:10:23.145326 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.145206    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts86v\"/\"openshift-service-ca.crt\""
Jul 09 05:10:23.151026 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.150932    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts86v/must-gather-tlsqv"]
Jul 09 05:10:23.237979 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.237940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d411d200-94db-401f-ab78-6a86f985c357-must-gather-output\") pod \"must-gather-tlsqv\" (UID: \"d411d200-94db-401f-ab78-6a86f985c357\") " pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.238175 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.237995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7bw\" (UniqueName: \"kubernetes.io/projected/d411d200-94db-401f-ab78-6a86f985c357-kube-api-access-xx7bw\") pod \"must-gather-tlsqv\" (UID: \"d411d200-94db-401f-ab78-6a86f985c357\") " pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.339129 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.339088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d411d200-94db-401f-ab78-6a86f985c357-must-gather-output\") pod \"must-gather-tlsqv\" (UID: \"d411d200-94db-401f-ab78-6a86f985c357\") " pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.339337 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.339147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7bw\" (UniqueName: \"kubernetes.io/projected/d411d200-94db-401f-ab78-6a86f985c357-kube-api-access-xx7bw\") pod \"must-gather-tlsqv\" (UID: \"d411d200-94db-401f-ab78-6a86f985c357\") " pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.339512 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.339490    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d411d200-94db-401f-ab78-6a86f985c357-must-gather-output\") pod \"must-gather-tlsqv\" (UID: \"d411d200-94db-401f-ab78-6a86f985c357\") " pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.352263 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.352231    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7bw\" (UniqueName: \"kubernetes.io/projected/d411d200-94db-401f-ab78-6a86f985c357-kube-api-access-xx7bw\") pod \"must-gather-tlsqv\" (UID: \"d411d200-94db-401f-ab78-6a86f985c357\") " pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.453938 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.453835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts86v/must-gather-tlsqv"
Jul 09 05:10:23.588312 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.588285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts86v/must-gather-tlsqv"]
Jul 09 05:10:23.590251 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:10:23.590225    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd411d200_94db_401f_ab78_6a86f985c357.slice/crio-5aec9469a58677ee87a2278897293a34f4ef43f031530fdce79a1e473d0203f6 WatchSource:0}: Error finding container 5aec9469a58677ee87a2278897293a34f4ef43f031530fdce79a1e473d0203f6: Status 404 returned error can't find the container with id 5aec9469a58677ee87a2278897293a34f4ef43f031530fdce79a1e473d0203f6
Jul 09 05:10:23.592251 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:23.592233    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 05:10:24.399126 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:24.399099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts86v/must-gather-tlsqv" event={"ID":"d411d200-94db-401f-ab78-6a86f985c357","Type":"ContainerStarted","Data":"5aec9469a58677ee87a2278897293a34f4ef43f031530fdce79a1e473d0203f6"}
Jul 09 05:10:25.409098 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:25.409059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts86v/must-gather-tlsqv" event={"ID":"d411d200-94db-401f-ab78-6a86f985c357","Type":"ContainerStarted","Data":"4e4521e352062e1d7591899fa389845c7f2bc30731f0c4ba409688eb37f227f1"}
Jul 09 05:10:25.409561 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:25.409110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts86v/must-gather-tlsqv" event={"ID":"d411d200-94db-401f-ab78-6a86f985c357","Type":"ContainerStarted","Data":"70eb41eafd97f25523c476d1c19eb561449f0750511867efd865de1fcd19441c"}
Jul 09 05:10:25.429625 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:25.429550    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts86v/must-gather-tlsqv" podStartSLOduration=1.632616601 podStartE2EDuration="2.429525532s" totalImagesPullingTime="796.908931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:10:25.426870573 +0000 UTC m=+2292.587291095" watchObservedRunningTime="2026-07-09 05:10:25.429525532 +0000 UTC m=+2292.589946053"
Jul 09 05:10:25.939568 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:25.939532    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5wzfg_350a4e3a-b0df-4b14-9a1c-7337f7e933b0/global-pull-secret-syncer/0.log"
Jul 09 05:10:26.108153 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:26.108091    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mpvjz_6f4a58c8-35e2-4fd6-b0ba-8849c606fe43/konnectivity-agent/0.log"
Jul 09 05:10:26.160253 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:26.160221    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-202.ec2.internal_4b12aea9bf8b99530f8679e8c6d1d16c/haproxy/0.log"
Jul 09 05:10:31.159043 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.158991    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs_e18f7959-55de-4dca-a727-1df7ec3fba24/extract/0.log"
Jul 09 05:10:31.183128 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.183095    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs_e18f7959-55de-4dca-a727-1df7ec3fba24/util/0.log"
Jul 09 05:10:31.209928 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.209894    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vv4cs_e18f7959-55de-4dca-a727-1df7ec3fba24/pull/0.log"
Jul 09 05:10:31.241724 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.241692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz_086e009e-0228-41f3-b615-9288907e5e23/extract/0.log"
Jul 09 05:10:31.265257 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.265220    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz_086e009e-0228-41f3-b615-9288907e5e23/util/0.log"
Jul 09 05:10:31.288071 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.288033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nplxz_086e009e-0228-41f3-b615-9288907e5e23/pull/0.log"
Jul 09 05:10:31.332514 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.332478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65_c30e37e4-b222-4106-acef-b654d94183f6/extract/0.log"
Jul 09 05:10:31.355714 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.355683    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65_c30e37e4-b222-4106-acef-b654d94183f6/util/0.log"
Jul 09 05:10:31.379683 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.379630    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bb65_c30e37e4-b222-4106-acef-b654d94183f6/pull/0.log"
Jul 09 05:10:31.410384 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.410296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9_496fb746-9237-41c9-8d4d-4bff5ee8d63a/extract/0.log"
Jul 09 05:10:31.457256 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.457215    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9_496fb746-9237-41c9-8d4d-4bff5ee8d63a/util/0.log"
Jul 09 05:10:31.476977 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:31.476933    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6kp9_496fb746-9237-41c9-8d4d-4bff5ee8d63a/pull/0.log"
Jul 09 05:10:32.038592 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:32.037664    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qmkm9_16343375-8c73-4daf-8341-e5562a333757/manager/0.log"
Jul 09 05:10:33.837790 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:33.837756    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_765d304a-b49d-4a9c-9c1f-293c4bce4f55/alertmanager/0.log"
Jul 09 05:10:33.866935 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:33.866906    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_765d304a-b49d-4a9c-9c1f-293c4bce4f55/config-reloader/0.log"
Jul 09 05:10:33.921444 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:33.921412    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_765d304a-b49d-4a9c-9c1f-293c4bce4f55/kube-rbac-proxy-web/0.log"
Jul 09 05:10:33.982790 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:33.982764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_765d304a-b49d-4a9c-9c1f-293c4bce4f55/kube-rbac-proxy/0.log"
Jul 09 05:10:34.030741 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.030712    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_765d304a-b49d-4a9c-9c1f-293c4bce4f55/kube-rbac-proxy-metric/0.log"
Jul 09 05:10:34.054020 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.053967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_765d304a-b49d-4a9c-9c1f-293c4bce4f55/prom-label-proxy/0.log"
Jul 09 05:10:34.079269 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.079219    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_765d304a-b49d-4a9c-9c1f-293c4bce4f55/init-config-reloader/0.log"
Jul 09 05:10:34.210676 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.210542    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d8d8bdb8b-kldp9_df4fe430-24c6-482c-be9c-9d7c03d10622/metrics-server/0.log"
Jul 09 05:10:34.236284 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.236257    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-rw9bk_3678f0c2-1f4f-470c-8920-0fe33ccd5c18/monitoring-plugin/0.log"
Jul 09 05:10:34.426714 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.426673    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cng67_e25147d0-b85f-47e7-8ded-6209e3f875e4/node-exporter/0.log"
Jul 09 05:10:34.447032 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.447003    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cng67_e25147d0-b85f-47e7-8ded-6209e3f875e4/kube-rbac-proxy/0.log"
Jul 09 05:10:34.470084 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.469957    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cng67_e25147d0-b85f-47e7-8ded-6209e3f875e4/init-textfile/0.log"
Jul 09 05:10:34.745020 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.744985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9kdfb_fc1d4111-6fa3-4f51-9de8-9f3b8430f54a/prometheus-operator/0.log"
Jul 09 05:10:34.761124 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.761093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9kdfb_fc1d4111-6fa3-4f51-9de8-9f3b8430f54a/kube-rbac-proxy/0.log"
Jul 09 05:10:34.787016 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.786971    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-49x2l_a300d608-2513-4476-b935-ad41da68dbb6/prometheus-operator-admission-webhook/0.log"
Jul 09 05:10:34.818981 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.818949    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6445d7d8dd-2wj8s_cae54d10-84d3-4afc-82a1-dc2f910198bf/telemeter-client/0.log"
Jul 09 05:10:34.849702 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.849667    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6445d7d8dd-2wj8s_cae54d10-84d3-4afc-82a1-dc2f910198bf/reload/0.log"
Jul 09 05:10:34.873186 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:34.873155    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6445d7d8dd-2wj8s_cae54d10-84d3-4afc-82a1-dc2f910198bf/kube-rbac-proxy/0.log"
Jul 09 05:10:36.222332 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.222295    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"]
Jul 09 05:10:36.231369 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.231338    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.233584 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.233555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"]
Jul 09 05:10:36.282142 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.282100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-lib-modules\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.282363 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.282194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-sys\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.282363 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.282284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-podres\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.282363 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.282316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-proc\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.282534 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.282364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh2bv\" (UniqueName: \"kubernetes.io/projected/2bbf1d3c-717e-484f-90c9-b6f1258aa061-kube-api-access-kh2bv\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383588 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-podres\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383783 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-proc\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383783 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh2bv\" (UniqueName: \"kubernetes.io/projected/2bbf1d3c-717e-484f-90c9-b6f1258aa061-kube-api-access-kh2bv\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383783 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-lib-modules\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383783 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-podres\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383947 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-sys\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383947 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383853    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-lib-modules\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.383947 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.383941    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-sys\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.384171 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.384152    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bbf1d3c-717e-484f-90c9-b6f1258aa061-proc\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.391733 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.391698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh2bv\" (UniqueName: \"kubernetes.io/projected/2bbf1d3c-717e-484f-90c9-b6f1258aa061-kube-api-access-kh2bv\") pod \"perf-node-gather-daemonset-htr8t\" (UID: \"2bbf1d3c-717e-484f-90c9-b6f1258aa061\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.546193 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.546152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:36.729446 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:36.729391    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"]
Jul 09 05:10:36.732822 ip-10-0-134-202 kubenswrapper[2563]: W0709 05:10:36.732788    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bbf1d3c_717e_484f_90c9_b6f1258aa061.slice/crio-8753757417c2740b8bd6c1a432c8142983fd28ced8bdf8f897483a6a335d473c WatchSource:0}: Error finding container 8753757417c2740b8bd6c1a432c8142983fd28ced8bdf8f897483a6a335d473c: Status 404 returned error can't find the container with id 8753757417c2740b8bd6c1a432c8142983fd28ced8bdf8f897483a6a335d473c
Jul 09 05:10:37.504557 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:37.504518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t" event={"ID":"2bbf1d3c-717e-484f-90c9-b6f1258aa061","Type":"ContainerStarted","Data":"8b1f2b87cc157a882851a26dd3dd7d09a6c9a222796700413eacd7c273c18ce6"}
Jul 09 05:10:37.504986 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:37.504577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t" event={"ID":"2bbf1d3c-717e-484f-90c9-b6f1258aa061","Type":"ContainerStarted","Data":"8753757417c2740b8bd6c1a432c8142983fd28ced8bdf8f897483a6a335d473c"}
Jul 09 05:10:37.504986 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:37.504685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:37.521525 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:37.521468    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t" podStartSLOduration=1.521445714 podStartE2EDuration="1.521445714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 05:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:10:37.519768139 +0000 UTC m=+2304.680188681" watchObservedRunningTime="2026-07-09 05:10:37.521445714 +0000 UTC m=+2304.681866237"
Jul 09 05:10:37.524903 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:37.524862    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-g8vwv_b39a6618-144c-485e-b17e-37e81838370e/download-server/0.log"
Jul 09 05:10:39.092992 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:39.092945    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c78hh_d8aa47b7-0d13-47da-b40d-5cde02a8d396/dns/0.log"
Jul 09 05:10:39.115093 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:39.115063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c78hh_d8aa47b7-0d13-47da-b40d-5cde02a8d396/kube-rbac-proxy/0.log"
Jul 09 05:10:39.256677 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:39.256629    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mkhc4_2ef6d9a9-70fa-4853-a69c-bf8a3801895d/dns-node-resolver/0.log"
Jul 09 05:10:39.901342 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:39.901313    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z2mdq_450323ce-9fff-4a9a-8b3f-a5855a14ec9b/node-ca/0.log"
Jul 09 05:10:40.961218 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:40.961185    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47bc47d8-9nd5l_adc85dae-c570-4b52-96bf-b0321648ac0e/kube-auth-proxy/0.log"
Jul 09 05:10:41.782878 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:41.782842    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84fgp_4f17a5d0-890c-4198-a7d9-5db7cf99d3df/serve-healthcheck-canary/0.log"
Jul 09 05:10:42.391072 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:42.391033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qmfpd_a97b4d51-5ceb-43b2-b055-628ed26a925e/kube-rbac-proxy/0.log"
Jul 09 05:10:42.411770 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:42.411741    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qmfpd_a97b4d51-5ceb-43b2-b055-628ed26a925e/exporter/0.log"
Jul 09 05:10:42.434433 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:42.434391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qmfpd_a97b4d51-5ceb-43b2-b055-628ed26a925e/extractor/0.log"
Jul 09 05:10:43.524911 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:43.524886    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-htr8t"
Jul 09 05:10:44.939480 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:44.939262    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-cqmwf_93053eac-31a5-4383-8f9e-565627f4e01a/manager/1.log"
Jul 09 05:10:44.982903 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:44.982850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-cqmwf_93053eac-31a5-4383-8f9e-565627f4e01a/manager/0.log"
Jul 09 05:10:44.999930 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:44.999900    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-cqmwf_93053eac-31a5-4383-8f9e-565627f4e01a/copy-manifests/0.log"
Jul 09 05:10:46.517765 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:46.517726    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5895bc645c-srk5g_2d5688ab-3a93-404a-8b66-73f9f3468bc9/manager/0.log"
Jul 09 05:10:47.027713 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:47.027675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47bc47d8-9nd5l_adc85dae-c570-4b52-96bf-b0321648ac0e/kube-auth-proxy/0.log"
Jul 09 05:10:48.527077 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:48.527048    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47bc47d8-9nd5l_adc85dae-c570-4b52-96bf-b0321648ac0e/kube-auth-proxy/0.log"
Jul 09 05:10:51.419986 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:51.419958    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kb7j2_ebbbca45-6509-4463-a8a9-aa8425bb51f0/migrator/0.log"
Jul 09 05:10:51.439245 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:51.439217    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kb7j2_ebbbca45-6509-4463-a8a9-aa8425bb51f0/graceful-termination/0.log"
Jul 09 05:10:53.086884 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.086811    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wcn82_505231a1-3c45-41aa-8290-bd70ff742a2c/kube-multus-additional-cni-plugins/0.log"
Jul 09 05:10:53.108476 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.108447    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wcn82_505231a1-3c45-41aa-8290-bd70ff742a2c/egress-router-binary-copy/0.log"
Jul 09 05:10:53.129624 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.129592    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wcn82_505231a1-3c45-41aa-8290-bd70ff742a2c/cni-plugins/0.log"
Jul 09 05:10:53.149981 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.149957    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wcn82_505231a1-3c45-41aa-8290-bd70ff742a2c/bond-cni-plugin/0.log"
Jul 09 05:10:53.170673 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.170618    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wcn82_505231a1-3c45-41aa-8290-bd70ff742a2c/routeoverride-cni/0.log"
Jul 09 05:10:53.191555 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.191531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wcn82_505231a1-3c45-41aa-8290-bd70ff742a2c/whereabouts-cni-bincopy/0.log"
Jul 09 05:10:53.214932 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.214906    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wcn82_505231a1-3c45-41aa-8290-bd70ff742a2c/whereabouts-cni/0.log"
Jul 09 05:10:53.287351 ip-10-0-134-202 kubenswrapper[2563]: I0709 05:10:53.287314    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qp2h6_b3550305-0add-4db7-a0a5-8e307aa0b18e/kube-multus/0.log"