Jun 03 00:46:33.295865 ip-10-0-141-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 03 00:46:33.295879 ip-10-0-141-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 03 00:46:33.295888 ip-10-0-141-62 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 03 00:46:33.296173 ip-10-0-141-62 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 03 00:46:42.630358 ip-10-0-141-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 03 00:46:42.630372 ip-10-0-141-62 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 476fdb74e11e4a50bb71f2ef0448ebfd --
Jun 03 00:48:58.554958 ip-10-0-141-62 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 00:48:58.999951 ip-10-0-141-62 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 00:48:58.999951 ip-10-0-141-62 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 00:48:58.999951 ip-10-0-141-62 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 00:48:58.999951 ip-10-0-141-62 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 00:48:58.999951 ip-10-0-141-62 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 00:48:59.000888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.000798    2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 00:48:59.005515 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005497    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 00:48:59.005515 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005516    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005519    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005523    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005526    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005529    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005532    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005534    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005539    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005543    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005546    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005549    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005552    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005554    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005557    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005560    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005564    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005567    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005570    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005573    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 00:48:59.005584 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005576    2551 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005579    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005583    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005586    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005589    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005592    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005594    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005606    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005609    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005613    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005615    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005618    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005620    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005623    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005625    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005628    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005630    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005633    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005635    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 00:48:59.006064 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005638    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005640    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005642    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005646    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005649    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005652    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005654    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005657    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005671    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005674    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005676    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005679    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005681    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005684    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005686    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005689    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005693    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005695    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005698    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005701    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 00:48:59.006514 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005704    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005706    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005709    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005711    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005714    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005716    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005719    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005721    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005723    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005726    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005728    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005731    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005733    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005736    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005738    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005741    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005750    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005753    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005756    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005758    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 00:48:59.007023 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005761    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005764    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005766    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005768    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005771    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005773    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.005776    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006180    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006186    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006189    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006191    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006194    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006197    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006199    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006202    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006204    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006207    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006209    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006212    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006214    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 00:48:59.007502 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006217    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006220    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006222    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006224    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006227    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006229    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006232    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006234    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006237    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006240    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006242    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006245    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006247    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006249    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006252    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006254    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006257    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006259    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006262    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006265    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 00:48:59.007998 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006267    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006270    2551 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006272    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006275    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006277    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006280    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006282    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006285    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006287    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006290    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006294    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006297    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006300    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006304    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006307    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006309    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006312    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006314    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006317    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 00:48:59.008504 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006319    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006322    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006325    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006328    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006330    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006333    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006335    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006338    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006340    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006343    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006345    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006348    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006352    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006354    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006358    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006361    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006363    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006366    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006368    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 00:48:59.008984 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006371    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006375    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006378    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006380    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006383    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006385    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006387    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006390    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006392    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006395    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006397    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006400    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006402    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006405    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.006407    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006481    2551 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006489    2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006496    2551 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006500    2551 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006504    2551 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006507    2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 00:48:59.009443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006512    2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006516    2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006519    2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006522    2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006527    2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006531    2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006534    2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006537    2551 flags.go:64] FLAG: --cgroup-root=""
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006540    2551 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006543    2551 flags.go:64] FLAG: --client-ca-file=""
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006546    2551 flags.go:64] FLAG: --cloud-config=""
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006549    2551 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006552    2551 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006557    2551 flags.go:64] FLAG: --cluster-domain=""
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006560    2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006563    2551 flags.go:64] FLAG: --config-dir=""
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006566    2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006570    2551 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006573    2551 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006576    2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006579    2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006582    2551 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006586    2551 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006589    2551 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 00:48:59.010034 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006592    2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006595    2551 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006598    2551 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006602    2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006610    2551 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006613    2551 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006617    2551 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006620    2551 flags.go:64] FLAG: --enable-server="true"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006623    2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006628    2551 flags.go:64] FLAG: --event-burst="100"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006631    2551 flags.go:64] FLAG: --event-qps="50"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006633    2551 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006637    2551 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006640    2551 flags.go:64] FLAG: --eviction-hard=""
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006645    2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006648    2551 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006651    2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006653    2551 flags.go:64] FLAG: --eviction-soft=""
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006656    2551 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006674    2551 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006677    2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006680    2551 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006683    2551 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006686    2551 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006689    2551 flags.go:64] FLAG: --feature-gates=""
Jun 03 00:48:59.010653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006693    2551 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006696    2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006699    2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006702    2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006706    2551 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006709    2551 flags.go:64] FLAG: --help="false"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006712    2551 flags.go:64] FLAG: --hostname-override="ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006715    2551 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006718    2551 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006721    2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006724    2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006728    2551 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006731    2551 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006734    2551 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006737    2551 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006740    2551 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006743    2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006746    2551 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006749    2551 flags.go:64] FLAG: --kube-reserved=""
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006752    2551 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006755    2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006758    2551 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006761    2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006764    2551 flags.go:64] FLAG: --lock-file=""
Jun 03 00:48:59.011272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006766    2551 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006769    2551 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006772    2551 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006777    2551 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006780    2551 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006783    2551 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006786    2551 flags.go:64] FLAG: --logging-format="text"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006789    2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006792    2551 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006795    2551 flags.go:64] FLAG: --manifest-url=""
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006797    2551 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006803    2551 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006806    2551 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006811    2551 flags.go:64] FLAG: --max-pods="110"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006814    2551 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006817    2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006820    2551 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006823    2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006826    2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006829    2551 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006832    2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006840    2551 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006843    2551 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006846    2551 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 00:48:59.011908 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006849    2551 flags.go:64] FLAG: --pod-cidr=""
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006852    2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006857    2551 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006860    2551 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006864    2551 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006867    2551 flags.go:64] FLAG: --port="10250"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006870    2551 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006873    2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0713945afbc9b435d"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006876    2551 flags.go:64] FLAG: --qos-reserved=""
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006879    2551 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006882    2551 flags.go:64] FLAG: --register-node="true"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006885    2551 flags.go:64] FLAG: --register-schedulable="true"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006888    2551 flags.go:64] FLAG: --register-with-taints=""
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006891    2551 flags.go:64] FLAG: --registry-burst="10"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006894    2551 flags.go:64] FLAG: --registry-qps="5"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006897    2551 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006900    2551 flags.go:64] FLAG: --reserved-memory=""
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006904    2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006907    2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006911    2551 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006914    2551 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006916    2551 flags.go:64] FLAG: --runonce="false"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006919    2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006922    2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006925    2551 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 00:48:59.012503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006928    2551 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006931    2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006934    2551 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006937    2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006940    2551 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006943    2551 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006946    2551 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006954    2551 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006956    2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006959    2551 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006963    2551 flags.go:64] FLAG: --system-cgroups=""
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006966    2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006971    2551 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006974    2551 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006977    2551 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006982    2551 flags.go:64] FLAG: --tls-min-version=""
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006984    2551 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006987    2551 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006990    2551 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006993    2551 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.006996    2551 flags.go:64] FLAG: --v="2"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.007001    2551 flags.go:64] FLAG: --version="false"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.007005    2551 flags.go:64] FLAG: --vmodule=""
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.007009    2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.007013    2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 00:48:59.013160 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007102    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007106    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007109    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007112    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007115    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007118    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007121    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007123    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007126    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007128    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007131    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007133    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007136    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007139    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007143    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007146    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007149    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007152    2551 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007155    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007158    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 00:48:59.013768 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007160    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007163    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007165    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007168    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007170    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007173    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007176    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007178    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007181    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007183    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007186    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007188    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007191    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007194    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007197    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007199    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007202    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007204    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007207    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007209    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 00:48:59.014267 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007212    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007214    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007217    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007219    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007222    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007224    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007229    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007232    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007234    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007237    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007239    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007242    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007244    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007247    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007249    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007252    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007254    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007258    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007262    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 00:48:59.014788 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007265    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007268    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007270    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007273    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007276    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007278    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007283    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007285    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007288    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007290    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007293    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007295    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007298    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007301    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007303    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007306    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007308    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007311    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007313    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007317    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 00:48:59.015261 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007320    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007324    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007327    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007330    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007333    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007336    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.007339    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.008362    2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.015044    2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.015061    2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015111    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015116    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015120    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015123    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015127    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 00:48:59.015763 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015130    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015133    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015135    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015139    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015141    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015144    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015146    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015149    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015152    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015155    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015157    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015160    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015164    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015168    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015171    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015174    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015176    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015180    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015183    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015185    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 00:48:59.016158 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015188    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015191    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015193    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015196    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015199    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015202    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015205    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015208    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015210    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015213    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015216    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015218    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015221    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015224    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015226    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015229    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015231    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015234    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015237    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015240    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 00:48:59.016650 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015242    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015245    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015248    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015250    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015253    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015255    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015258    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015260    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015263    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015266    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015269    2551 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015271    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015274    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015277    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015280    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015285    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015289    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015292    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015296    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 00:48:59.017156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015299    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015302    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015304    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015307    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015309    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015312    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015314    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015317    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015319    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015322    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015324    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015327    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015329    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015332    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015334    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015336    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015339    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015342    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015344    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015347    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 00:48:59.017626 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015349    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015352    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.015357    2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015480    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015485    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015489    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015492    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015495    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015498    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015501    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015504    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015507    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015510    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015513    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015515    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 00:48:59.018156 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015518    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015521    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015523    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015526    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015528    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015531    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015533    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015536    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015538    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015541    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015543    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015545    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015548    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015550    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015553    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015555    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015558    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015560    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015563    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015565    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 00:48:59.018537 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015567    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015570    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015575    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015578    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015581    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015584    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015587    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015589    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015592    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015595    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015598    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015600    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015603    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015605    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015608    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015610    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015613    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015615    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015618    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 00:48:59.019025 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015620    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015623    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015625    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015628    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015630    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015633    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015635    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015638    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015640    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015642    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015645    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015647    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015650    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015652    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015655    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015657    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015686    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015689    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015692    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015695    2551 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 00:48:59.019491 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015698    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015701    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015703    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015706    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015709    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015712    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015716    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015719    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015721    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015724    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015726    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015728    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015731    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015733    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:48:59.015735    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.015740    2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 00:48:59.020005 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.016683    2551 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 00:48:59.020413 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.019817    2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 00:48:59.020876 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.020864    2551 server.go:1019] "Starting client certificate rotation"
Jun 03 00:48:59.020978 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.020961    2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 00:48:59.021010 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.021001    2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 00:48:59.051459 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.051430    2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 00:48:59.056326 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.056305    2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 00:48:59.072726 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.072706    2551 log.go:25] "Validated CRI v1 runtime API"
Jun 03 00:48:59.078754 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.078727    2551 log.go:25] "Validated CRI v1 image API"
Jun 03 00:48:59.080056 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.080038    2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 00:48:59.082052 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.082036    2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 00:48:59.086761 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.086742    2551 fs.go:135] Filesystem UUIDs: map[70e268f2-0222-46c2-8489-f8906222f85c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9b2e0543-f8c0-4d79-8310-456ea1a0d73b:/dev/nvme0n1p4]
Jun 03 00:48:59.086810 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.086762    2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 00:48:59.091241 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.091127    2551 manager.go:217] Machine: {Timestamp:2026-06-03 00:48:59.090603114 +0000 UTC m=+0.417112431 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097673 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec211c1c80cdbc2ebcf296a20ab2f965 SystemUUID:ec211c1c-80cd-bc2e-bcf2-96a20ab2f965 BootID:476fdb74-e11e-4a50-bb71-f2ef0448ebfd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:b3:f6:88:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:b3:f6:88:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:55:97:a2:4b:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 00:48:59.092510 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.092496    2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 00:48:59.092603 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.092588    2551 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 00:48:59.094462 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.094428    2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 00:48:59.094624 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.094464    2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 00:48:59.094683 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.094634    2551 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 00:48:59.094683 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.094644    2551 container_manager_linux.go:306] "Creating device plugin manager"
Jun 03 00:48:59.094683 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.094652    2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 00:48:59.097517 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.097501    2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 00:48:59.099561 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.099548    2551 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 00:48:59.099694 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.099686    2551 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 03 00:48:59.101794 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.101783    2551 kubelet.go:491] "Attempting to sync node with API server"
Jun 03 00:48:59.101837 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.101799    2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 00:48:59.101837 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.101812    2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 00:48:59.101837 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.101822    2551 kubelet.go:397] "Adding apiserver pod source"
Jun 03 00:48:59.101837 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.101831    2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 00:48:59.102935 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.102923    2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 00:48:59.102995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.102943    2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 00:48:59.102995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.102933    2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp7vw"
Jun 03 00:48:59.106149 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.106131    2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 03 00:48:59.108023 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.107994    2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 00:48:59.109952 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109936    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109959    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109966    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109972    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109981    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109987    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109992    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.109998    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 00:48:59.110003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.110004    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 00:48:59.110222 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.110010    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 00:48:59.110222 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.110024    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 00:48:59.110222 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.110030    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 00:48:59.110814 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.110804    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 00:48:59.110852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.110815    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 00:48:59.113552 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.113533    2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp7vw"
Jun 03 00:48:59.114748 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.114695    2551 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 00:48:59.114855 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.114762    2551 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 03 00:48:59.114855 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.114840    2551 server.go:1295] "Started kubelet"
Jun 03 00:48:59.114955 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.114835    2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 00:48:59.114955 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.114851    2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 00:48:59.115267 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.115231    2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 00:48:59.115370 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.115328    2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 00:48:59.115460 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.115449    2551 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 03 00:48:59.115931 ip-10-0-141-62 systemd[1]: Started Kubernetes Kubelet.
Jun 03 00:48:59.119722 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.119700    2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 00:48:59.121459 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.121442    2551 server.go:317] "Adding debug handlers to kubelet server"
Jun 03 00:48:59.124584 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.124566    2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 00:48:59.124681 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.124589    2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 00:48:59.124681 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.124674    2551 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 03 00:48:59.124794 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.124686    2551 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 03 00:48:59.124794 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.124785    2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 03 00:48:59.124887 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.124852    2551 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 00:48:59.124887 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.124860    2551 reconciler.go:26] "Reconciler: start to sync state"
Jun 03 00:48:59.125345 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.125312    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.127431 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.127411    2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 00:48:59.128361 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.128124    2551 factory.go:55] Registering systemd factory
Jun 03 00:48:59.128361 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.128142    2551 factory.go:223] Registration of the systemd container factory successfully
Jun 03 00:48:59.128487 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.128415    2551 factory.go:153] Registering CRI-O factory
Jun 03 00:48:59.128487 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.128431    2551 factory.go:223] Registration of the crio container factory successfully
Jun 03 00:48:59.128585 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.128487    2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 00:48:59.128585 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.128505    2551 factory.go:103] Registering Raw factory
Jun 03 00:48:59.128585 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.128519    2551 manager.go:1196] Started watching for new ooms in manager
Jun 03 00:48:59.129138 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.129122    2551 manager.go:319] Starting recovery of all containers
Jun 03 00:48:59.129521 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.129498    2551 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-62.ec2.internal\" not found" node="ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.129800 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.129776    2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 00:48:59.139828 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.139717    2551 manager.go:324] Recovery completed
Jun 03 00:48:59.144308 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.144293    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 00:48:59.146389 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.146373    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 00:48:59.146464 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.146405    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 00:48:59.146464 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.146420    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 00:48:59.146983 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.146968    2551 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 00:48:59.146983 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.146982    2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 00:48:59.147070 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.146999    2551 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 00:48:59.149448 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.149436    2551 policy_none.go:49] "None policy: Start"
Jun 03 00:48:59.149484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.149452    2551 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 03 00:48:59.149484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.149462    2551 state_mem.go:35] "Initializing new in-memory state store"
Jun 03 00:48:59.187372 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.187300    2551 manager.go:341] "Starting Device Plugin manager"
Jun 03 00:48:59.187372 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.187337    2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 00:48:59.187372 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.187351    2551 server.go:85] "Starting device plugin registration server"
Jun 03 00:48:59.187650 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.187638    2551 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 00:48:59.187715 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.187652    2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 00:48:59.187790 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.187775    2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 00:48:59.187890 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.187878    2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 00:48:59.187944 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.187891    2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 00:48:59.188523 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.188503    2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 00:48:59.188629 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.188539    2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.217586 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.217548    2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 03 00:48:59.218684 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.218654    2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 03 00:48:59.218684 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.218687    2551 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 03 00:48:59.218822 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.218709    2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 00:48:59.218822 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.218716    2551 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 03 00:48:59.218822 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.218759    2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 00:48:59.222075 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.222055    2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 00:48:59.288273 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.288181    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 00:48:59.289199 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.289181    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 00:48:59.289304 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.289209    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 00:48:59.289304 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.289219    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 00:48:59.289304 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.289247    2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.297566 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.297548    2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.297691 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.297575    2551 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-62.ec2.internal\": node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.319121 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.319089    2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal"]
Jun 03 00:48:59.319277 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.319177    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 00:48:59.320088 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.320071    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 00:48:59.320195 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.320108    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 00:48:59.320195 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.320122    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 00:48:59.321615 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.321599    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 00:48:59.321760 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.321745    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.321812 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.321775    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 00:48:59.322365 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.322348    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 00:48:59.322430 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.322387    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 00:48:59.322430 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.322397    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 00:48:59.322494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.322348    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 00:48:59.322494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.322472    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 00:48:59.322494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.322485    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 00:48:59.323627 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.323612    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.323712 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.323644    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 00:48:59.324621 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.324607    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 00:48:59.324723 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.324631    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 00:48:59.324723 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.324641    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 00:48:59.328211 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.328191    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.347557 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.347530    2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-62.ec2.internal\" not found" node="ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.352195 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.352172    2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-62.ec2.internal\" not found" node="ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.426113 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.426077    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/685d7175fd0d9934757a21eb2bb59cd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal\" (UID: \"685d7175fd0d9934757a21eb2bb59cd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.426113 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.426110    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/685d7175fd0d9934757a21eb2bb59cd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal\" (UID: \"685d7175fd0d9934757a21eb2bb59cd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.426320 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.426130    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe05e4f784b8c17aa7c181730d5d5b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-62.ec2.internal\" (UID: \"cfe05e4f784b8c17aa7c181730d5d5b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.428445 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.428430    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.526326 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.526291    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/685d7175fd0d9934757a21eb2bb59cd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal\" (UID: \"685d7175fd0d9934757a21eb2bb59cd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.526402 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.526327    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/685d7175fd0d9934757a21eb2bb59cd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal\" (UID: \"685d7175fd0d9934757a21eb2bb59cd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.526402 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.526348    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe05e4f784b8c17aa7c181730d5d5b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-62.ec2.internal\" (UID: \"cfe05e4f784b8c17aa7c181730d5d5b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.526478 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.526399    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe05e4f784b8c17aa7c181730d5d5b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-62.ec2.internal\" (UID: \"cfe05e4f784b8c17aa7c181730d5d5b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.526478 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.526403    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/685d7175fd0d9934757a21eb2bb59cd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal\" (UID: \"685d7175fd0d9934757a21eb2bb59cd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.526478 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.526419    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/685d7175fd0d9934757a21eb2bb59cd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal\" (UID: \"685d7175fd0d9934757a21eb2bb59cd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.529376 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.529356    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.630134 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.630072    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.650266 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.650237    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.655722 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:48:59.655705    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal"
Jun 03 00:48:59.730900 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.730860    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.831380 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.831347    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:48:59.931950 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:48:59.931859    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:49:00.021191 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.021161    2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 00:49:00.021687 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.021313    2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 00:49:00.021687 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.021318    2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 00:49:00.032614 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:00.032583    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:49:00.115417 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.115369    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:43:59 +0000 UTC" deadline="2027-12-20 21:58:33.774675043 +0000 UTC"
Jun 03 00:49:00.115417 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.115406    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13581h9m33.659271335s"
Jun 03 00:49:00.125094 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.125073    2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 00:49:00.133452 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:00.133426    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:49:00.135941 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.135919    2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 00:49:00.150006 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:00.149967    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685d7175fd0d9934757a21eb2bb59cd1.slice/crio-a2dca2c65ea298279e2892184cc7a24a796a2cf9a2e20168e25caf9b1b3b544a WatchSource:0}: Error finding container a2dca2c65ea298279e2892184cc7a24a796a2cf9a2e20168e25caf9b1b3b544a: Status 404 returned error can't find the container with id a2dca2c65ea298279e2892184cc7a24a796a2cf9a2e20168e25caf9b1b3b544a
Jun 03 00:49:00.150194 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:00.150175    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe05e4f784b8c17aa7c181730d5d5b7.slice/crio-09a3fa8b587e2915f85a1beb27722560a82bbce0f7c342eac1e653a43a4f29c3 WatchSource:0}: Error finding container 09a3fa8b587e2915f85a1beb27722560a82bbce0f7c342eac1e653a43a4f29c3: Status 404 returned error can't find the container with id 09a3fa8b587e2915f85a1beb27722560a82bbce0f7c342eac1e653a43a4f29c3
Jun 03 00:49:00.152888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.152869    2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xqsb"
Jun 03 00:49:00.153528 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.153513    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 00:49:00.160514 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.160493    2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xqsb"
Jun 03 00:49:00.222290 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.222181    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal" event={"ID":"cfe05e4f784b8c17aa7c181730d5d5b7","Type":"ContainerStarted","Data":"09a3fa8b587e2915f85a1beb27722560a82bbce0f7c342eac1e653a43a4f29c3"}
Jun 03 00:49:00.223158 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.223138    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal" event={"ID":"685d7175fd0d9934757a21eb2bb59cd1","Type":"ContainerStarted","Data":"a2dca2c65ea298279e2892184cc7a24a796a2cf9a2e20168e25caf9b1b3b544a"}
Jun 03 00:49:00.233519 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:00.233490    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:49:00.334034 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:00.334002    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:49:00.434549 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:00.434510    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:49:00.535104 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:00.535033    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-62.ec2.internal\" not found"
Jun 03 00:49:00.599548 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.599521    2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 00:49:00.627679 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.627643    2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 00:49:00.725008 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.724972    2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal"
Jun 03 00:49:00.737932 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.737904    2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 00:49:00.741553 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.739212    2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal"
Jun 03 00:49:00.747316 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.747289    2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 00:49:00.849016 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:00.848934    2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 00:49:01.103687 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.103588    2551 apiserver.go:52] "Watching apiserver"
Jun 03 00:49:01.110178 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.110147    2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 00:49:01.110596 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.110563    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-cgs7v","openshift-dns/node-resolver-m9tb7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal","openshift-multus/multus-2cgzj","openshift-multus/multus-additional-cni-plugins-rl4tw","openshift-multus/network-metrics-daemon-9b5w7","openshift-ovn-kubernetes/ovnkube-node-bmwgr","kube-system/konnectivity-agent-4gs9t","kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7","openshift-cluster-node-tuning-operator/tuned-bctwc","openshift-image-registry/node-ca-rpt6m","openshift-network-diagnostics/network-check-target-6jg28"]
Jun 03 00:49:01.112348 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.112327    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.113502 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.113481    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.114778 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.114756    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.115224 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115202    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 00:49:01.115326 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115246    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 00:49:01.115326 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115295    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 00:49:01.115445 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115344    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cdsp\""
Jun 03 00:49:01.115505 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115462    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 00:49:01.115505 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115479    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 00:49:01.115613 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115528    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 00:49:01.116024 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.115991    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 00:49:01.116505 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.116244    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 00:49:01.116505 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.116266    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.116505 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.116251    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g7tsl\""
Jun 03 00:49:01.117203 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.117185    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 00:49:01.117425 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.117407    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 00:49:01.117504 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.117477    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 00:49:01.117605 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.117586    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 00:49:01.117688 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.117678    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ssllf\""
Jun 03 00:49:01.118013 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.117995    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:01.118105 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.118066    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:01.118485 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.118466    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 00:49:01.118572 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.118469    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xfs87\""
Jun 03 00:49:01.118572 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.118475    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 00:49:01.119509 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.119380    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.122271 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.122250    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 00:49:01.122507 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.122487    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 00:49:01.122640 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.122609    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j2jrw\""
Jun 03 00:49:01.122763 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.122741    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 00:49:01.123932 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.123909    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.124070 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.124054    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.125533 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.125451    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.126453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.126434    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gzlnm\""
Jun 03 00:49:01.126641 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.126626    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 00:49:01.126725 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.126711    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 00:49:01.126839 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.126822    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 00:49:01.126922 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.126857    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tpgh8\""
Jun 03 00:49:01.126922 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.126878    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 00:49:01.127060 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.126945    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 00:49:01.127231 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.127212    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.127839 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.127795    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 00:49:01.127934 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.127874    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8v9nb\""
Jun 03 00:49:01.127999 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.127935    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 00:49:01.128409 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.128388    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:01.128492 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.128457    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:01.129626 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.129564    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 00:49:01.129967 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.129948    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 00:49:01.130058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.130004    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 00:49:01.130058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.129956    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qgbmj\""
Jun 03 00:49:01.135438 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135411    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-modprobe-d\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.135543 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135451    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-sys\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.135543 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135479    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-systemd\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.135543 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135509    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-os-release\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.135543 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135532    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.135775 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135557    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-systemd-units\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.135775 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135600    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8t6\" (UniqueName: \"kubernetes.io/projected/d3ede5a2-a50e-447b-8346-d6d09b0065bb-kube-api-access-bw8t6\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.135775 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135622    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6j62\" (UniqueName: \"kubernetes.io/projected/2676174a-ae2c-4c9c-b960-1381fb094d19-kube-api-access-r6j62\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.135775 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135638    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv48w\" (UniqueName: \"kubernetes.io/projected/88c208bf-a858-45e7-8760-800f85eb72b5-kube-api-access-nv48w\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.135775 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135653    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfb1e82-0178-4268-8114-fadb988236ea-tmp\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.135775 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135697    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-cni-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.135775 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135746    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-socket-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135772    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-run-netns\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135796    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-systemd\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135810    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-cni-netd\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135827    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-var-lib-kubelet\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135873    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135933    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.135972    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-host\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136002    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfb1e82-0178-4268-8114-fadb988236ea-etc-tuned\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136036    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65cn\" (UniqueName: \"kubernetes.io/projected/ecfb1e82-0178-4268-8114-fadb988236ea-kube-api-access-n65cn\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136054    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/286f5172-7063-473f-93fd-a2a662469b48-tmp-dir\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.136112 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136092    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-cni-multus\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136133    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-multus-certs\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136175    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-system-cni-dir\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136199    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-kubernetes\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136249    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysctl-conf\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136281    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/286f5172-7063-473f-93fd-a2a662469b48-hosts-file\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136317    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-k8s-cni-cncf-io\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136350    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-os-release\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136381    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-kubelet\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136425    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136457    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136484    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-lib-modules\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136506    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-cnibin\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136529    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-etc-kubernetes\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136552    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxcdd\" (UniqueName: \"kubernetes.io/projected/d7f27f4d-335b-47cb-b268-9df19c5d9951-kube-api-access-lxcdd\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136578    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4d7w\" (UniqueName: \"kubernetes.io/projected/a324a5b0-5b91-43ac-9729-760253808de5-kube-api-access-p4d7w\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.136612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136614    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovn-node-metrics-cert\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136644    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136684    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88c208bf-a858-45e7-8760-800f85eb72b5-host-slash\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136707    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136731    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovnkube-config\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136765    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ed7f138-3af8-4d0c-a009-55006ff67942-agent-certs\") pod \"konnectivity-agent-4gs9t\" (UID: \"6ed7f138-3af8-4d0c-a009-55006ff67942\") " pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136793    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysconfig\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136838    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-run\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136869    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqrcl\" (UniqueName: \"kubernetes.io/projected/286f5172-7063-473f-93fd-a2a662469b48-kube-api-access-dqrcl\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136893    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-kubelet\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136917    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cnibin\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136942    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlp4\" (UniqueName: \"kubernetes.io/projected/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-kube-api-access-2vlp4\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136967    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-var-lib-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.136993    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-socket-dir-parent\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137023    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-cni-bin\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137094    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:01.137511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137120    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovnkube-script-lib\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137140    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88c208bf-a858-45e7-8760-800f85eb72b5-iptables-alerter-script\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137163    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-registration-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137179    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-device-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137204    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-sys-fs\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137223    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-ovn\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137258    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-node-log\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137292    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-netns\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137327    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-log-socket\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137364    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ed7f138-3af8-4d0c-a009-55006ff67942-konnectivity-ca\") pod \"konnectivity-agent-4gs9t\" (UID: \"6ed7f138-3af8-4d0c-a009-55006ff67942\") " pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137413    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2676174a-ae2c-4c9c-b960-1381fb094d19-cni-binary-copy\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137449    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-conf-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137476    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-daemon-config\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137500    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-etc-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137523    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-etc-selinux\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137547    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysctl-d\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.138382 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137569    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-slash\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.139249 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137591    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-cni-bin\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.139249 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137619    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-system-cni-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.139249 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137649    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-hostroot\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.139249 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137694    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.139249 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.137728    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-env-overrides\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.161505 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.161328    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:44:00 +0000 UTC" deadline="2028-02-23 10:05:49.037729422 +0000 UTC"
Jun 03 00:49:01.161505 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.161386    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15129h16m47.876349438s"
Jun 03 00:49:01.226168 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.226138    2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 03 00:49:01.238379 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238345    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-kubelet\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238379 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238378    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238594 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238401    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238594 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238430    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-lib-modules\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.238594 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238450    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-kubelet\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238594 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238505    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238594 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238550    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-cnibin\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.238594 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238581    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238594    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-etc-kubernetes\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238613    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-cnibin\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238624    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxcdd\" (UniqueName: \"kubernetes.io/projected/d7f27f4d-335b-47cb-b268-9df19c5d9951-kube-api-access-lxcdd\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238653    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4d7w\" (UniqueName: \"kubernetes.io/projected/a324a5b0-5b91-43ac-9729-760253808de5-kube-api-access-p4d7w\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238625    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-etc-kubernetes\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238681    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-lib-modules\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238692    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovn-node-metrics-cert\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238719    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238750    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88c208bf-a858-45e7-8760-800f85eb72b5-host-slash\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238774    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238802    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovnkube-config\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238825    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ed7f138-3af8-4d0c-a009-55006ff67942-agent-certs\") pod \"konnectivity-agent-4gs9t\" (UID: \"6ed7f138-3af8-4d0c-a009-55006ff67942\") " pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.238852 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238849    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88c208bf-a858-45e7-8760-800f85eb72b5-host-slash\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238873    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysconfig\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238899    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-run\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238922    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqrcl\" (UniqueName: \"kubernetes.io/projected/286f5172-7063-473f-93fd-a2a662469b48-kube-api-access-dqrcl\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238948    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-kubelet\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238966    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238973    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cnibin\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.238990    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysconfig\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239011    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cnibin\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239022    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlp4\" (UniqueName: \"kubernetes.io/projected/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-kube-api-access-2vlp4\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239056    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-var-lib-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239067    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-run\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239085    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239117    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-socket-dir-parent\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239150    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-cni-bin\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239179    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239210    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovnkube-script-lib\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.239500 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239237    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/231d2c36-0c31-4915-8eef-57b32a58c80c-serviceca\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239238    2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239266    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88c208bf-a858-45e7-8760-800f85eb72b5-iptables-alerter-script\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239286    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-cni-bin\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239295    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-registration-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239289    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-var-lib-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239305    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239327    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-device-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239256    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-socket-dir-parent\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239344    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-registration-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239355    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-sys-fs\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.239359    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239365    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-kubelet\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239379    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-ovn\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239404    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-node-log\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239412    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-device-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.239427    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs podName:d7f27f4d-335b-47cb-b268-9df19c5d9951 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:01.739406538 +0000 UTC m=+3.065915847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs") pod "network-metrics-daemon-9b5w7" (UID: "d7f27f4d-335b-47cb-b268-9df19c5d9951") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:01.240366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239439    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-node-log\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239481    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-ovn\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239492    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-sys-fs\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239539    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231d2c36-0c31-4915-8eef-57b32a58c80c-host\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239570    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-netns\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239596    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-log-socket\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239640    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ed7f138-3af8-4d0c-a009-55006ff67942-konnectivity-ca\") pod \"konnectivity-agent-4gs9t\" (UID: \"6ed7f138-3af8-4d0c-a009-55006ff67942\") " pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239643    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-netns\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239687    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwjbr\" (UniqueName: \"kubernetes.io/projected/231d2c36-0c31-4915-8eef-57b32a58c80c-kube-api-access-bwjbr\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239703    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-log-socket\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239714    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2676174a-ae2c-4c9c-b960-1381fb094d19-cni-binary-copy\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239740    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-conf-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239784    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-daemon-config\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239807    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-etc-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239842    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-etc-selinux\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239869    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysctl-d\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239870    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88c208bf-a858-45e7-8760-800f85eb72b5-iptables-alerter-script\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239892    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-slash\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.241161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239940    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-cni-bin\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239941    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-etc-openvswitch\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.239982    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-conf-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240027    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-system-cni-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240057    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-hostroot\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240084    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240086    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-etc-selinux\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240111    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-env-overrides\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240131    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ed7f138-3af8-4d0c-a009-55006ff67942-konnectivity-ca\") pod \"konnectivity-agent-4gs9t\" (UID: \"6ed7f138-3af8-4d0c-a009-55006ff67942\") " pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240136    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-modprobe-d\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240177    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-sys\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240193    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysctl-d\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240223    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-modprobe-d\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240233    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-systemd\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240242    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-slash\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240262    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-os-release\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240297    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240312    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.242114 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240317    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2676174a-ae2c-4c9c-b960-1381fb094d19-cni-binary-copy\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240340    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-systemd-units\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240302    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-systemd\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240338    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-system-cni-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240373    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-os-release\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240416    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-hostroot\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240418    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-systemd-units\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240453    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-daemon-config\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240478    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-sys\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240650    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8t6\" (UniqueName: \"kubernetes.io/projected/d3ede5a2-a50e-447b-8346-d6d09b0065bb-kube-api-access-bw8t6\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240691    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6j62\" (UniqueName: \"kubernetes.io/projected/2676174a-ae2c-4c9c-b960-1381fb094d19-kube-api-access-r6j62\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240705    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240713    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nv48w\" (UniqueName: \"kubernetes.io/projected/88c208bf-a858-45e7-8760-800f85eb72b5-kube-api-access-nv48w\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240736    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfb1e82-0178-4268-8114-fadb988236ea-tmp\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240758    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-cni-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240815    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-socket-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240842    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-run-netns\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240868    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-systemd\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.242995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240892    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-cni-netd\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240919    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-var-lib-kubelet\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240938    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-env-overrides\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240949    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240978    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241003    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-run-netns\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241014    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovnkube-config\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241053    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-host\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241114    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-socket-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241100    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-run-systemd\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241147    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-multus-cni-dir\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241004    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-host\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241171    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a324a5b0-5b91-43ac-9729-760253808de5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241173    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-cni-netd\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241213    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-var-lib-kubelet\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241200    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfb1e82-0178-4268-8114-fadb988236ea-etc-tuned\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241275    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n65cn\" (UniqueName: \"kubernetes.io/projected/ecfb1e82-0178-4268-8114-fadb988236ea-kube-api-access-n65cn\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241303    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/286f5172-7063-473f-93fd-a2a662469b48-tmp-dir\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.243762 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241328    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-cni-multus\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241353    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-multus-certs\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241379    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-system-cni-dir\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241422    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-kubernetes\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241448    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysctl-conf\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241473    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/286f5172-7063-473f-93fd-a2a662469b48-hosts-file\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241498    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-k8s-cni-cncf-io\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241217    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovnkube-script-lib\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241604    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-os-release\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241626    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241704    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-system-cni-dir\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241721    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-os-release\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241744    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-var-lib-cni-multus\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241704    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-k8s-cni-cncf-io\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241790    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2676174a-ae2c-4c9c-b960-1381fb094d19-host-run-multus-certs\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241804    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/286f5172-7063-473f-93fd-a2a662469b48-hosts-file\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241818    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-kubernetes\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.244386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.241891    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfb1e82-0178-4268-8114-fadb988236ea-etc-sysctl-conf\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.244948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.240602    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3ede5a2-a50e-447b-8346-d6d09b0065bb-host-cni-bin\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.244948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.242070    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/286f5172-7063-473f-93fd-a2a662469b48-tmp-dir\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.244948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.243080    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3ede5a2-a50e-447b-8346-d6d09b0065bb-ovn-node-metrics-cert\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.244948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.243352    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfb1e82-0178-4268-8114-fadb988236ea-tmp\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.244948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.243458    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfb1e82-0178-4268-8114-fadb988236ea-etc-tuned\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.244948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.243619    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ed7f138-3af8-4d0c-a009-55006ff67942-agent-certs\") pod \"konnectivity-agent-4gs9t\" (UID: \"6ed7f138-3af8-4d0c-a009-55006ff67942\") " pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.249038 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.249012    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4d7w\" (UniqueName: \"kubernetes.io/projected/a324a5b0-5b91-43ac-9729-760253808de5-kube-api-access-p4d7w\") pod \"aws-ebs-csi-driver-node-rt7g7\" (UID: \"a324a5b0-5b91-43ac-9729-760253808de5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.256232 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.254166    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqrcl\" (UniqueName: \"kubernetes.io/projected/286f5172-7063-473f-93fd-a2a662469b48-kube-api-access-dqrcl\") pod \"node-resolver-m9tb7\" (UID: \"286f5172-7063-473f-93fd-a2a662469b48\") " pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.256232 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.254261    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlp4\" (UniqueName: \"kubernetes.io/projected/ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a-kube-api-access-2vlp4\") pod \"multus-additional-cni-plugins-rl4tw\" (UID: \"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a\") " pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.256232 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.254300    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxcdd\" (UniqueName: \"kubernetes.io/projected/d7f27f4d-335b-47cb-b268-9df19c5d9951-kube-api-access-lxcdd\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:01.258090 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.258040    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv48w\" (UniqueName: \"kubernetes.io/projected/88c208bf-a858-45e7-8760-800f85eb72b5-kube-api-access-nv48w\") pod \"iptables-alerter-cgs7v\" (UID: \"88c208bf-a858-45e7-8760-800f85eb72b5\") " pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.258209 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.258105    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8t6\" (UniqueName: \"kubernetes.io/projected/d3ede5a2-a50e-447b-8346-d6d09b0065bb-kube-api-access-bw8t6\") pod \"ovnkube-node-bmwgr\" (UID: \"d3ede5a2-a50e-447b-8346-d6d09b0065bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.258268 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.258237    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65cn\" (UniqueName: \"kubernetes.io/projected/ecfb1e82-0178-4268-8114-fadb988236ea-kube-api-access-n65cn\") pod \"tuned-bctwc\" (UID: \"ecfb1e82-0178-4268-8114-fadb988236ea\") " pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.258515 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.258496    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6j62\" (UniqueName: \"kubernetes.io/projected/2676174a-ae2c-4c9c-b960-1381fb094d19-kube-api-access-r6j62\") pod \"multus-2cgzj\" (UID: \"2676174a-ae2c-4c9c-b960-1381fb094d19\") " pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.342240 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.342197    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:01.342420 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.342259    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/231d2c36-0c31-4915-8eef-57b32a58c80c-serviceca\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.342420 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.342285    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231d2c36-0c31-4915-8eef-57b32a58c80c-host\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.342420 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.342302    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwjbr\" (UniqueName: \"kubernetes.io/projected/231d2c36-0c31-4915-8eef-57b32a58c80c-kube-api-access-bwjbr\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.342420 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.342406    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231d2c36-0c31-4915-8eef-57b32a58c80c-host\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.342753 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.342735    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/231d2c36-0c31-4915-8eef-57b32a58c80c-serviceca\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.348635 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.348612    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 00:49:01.348635 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.348639    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 00:49:01.348844 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.348652    2551 projected.go:194] Error preparing data for projected volume kube-api-access-rd2n5 for pod openshift-network-diagnostics/network-check-target-6jg28: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:01.348844 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.348727    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5 podName:51802faf-48c2-4861-b6b7-7ea49fffbe8b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:01.84870867 +0000 UTC m=+3.175217968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rd2n5" (UniqueName: "kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5") pod "network-check-target-6jg28" (UID: "51802faf-48c2-4861-b6b7-7ea49fffbe8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:01.351084 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.351062    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwjbr\" (UniqueName: \"kubernetes.io/projected/231d2c36-0c31-4915-8eef-57b32a58c80c-kube-api-access-bwjbr\") pod \"node-ca-rpt6m\" (UID: \"231d2c36-0c31-4915-8eef-57b32a58c80c\") " pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.426264 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.426178    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:01.433150 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.433127    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m9tb7"
Jun 03 00:49:01.441906 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.441879    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cgzj"
Jun 03 00:49:01.447623 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.447600    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rl4tw"
Jun 03 00:49:01.454556 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.454528    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgs7v"
Jun 03 00:49:01.463193 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.463168    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:01.469942 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.469912    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7"
Jun 03 00:49:01.476692 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.476656    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bctwc"
Jun 03 00:49:01.481359 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.481329    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rpt6m"
Jun 03 00:49:01.522406 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.522377    2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 00:49:01.745213 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.745131    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:01.745353 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.745247    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:01.745353 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.745303    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs podName:d7f27f4d-335b-47cb-b268-9df19c5d9951 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:02.745289254 +0000 UTC m=+4.071798541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs") pod "network-metrics-daemon-9b5w7" (UID: "d7f27f4d-335b-47cb-b268-9df19c5d9951") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:01.778962 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.778913    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286f5172_7063_473f_93fd_a2a662469b48.slice/crio-daa88b0f63c71ebb36294ef85d47f6040121aa0a4e192150cc089bf5bdc17b92 WatchSource:0}: Error finding container daa88b0f63c71ebb36294ef85d47f6040121aa0a4e192150cc089bf5bdc17b92: Status 404 returned error can't find the container with id daa88b0f63c71ebb36294ef85d47f6040121aa0a4e192150cc089bf5bdc17b92
Jun 03 00:49:01.780411 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.780388    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef24eea1_d7c1_4fe1_b10b_b18b0c504a3a.slice/crio-4476a86534d3c78a2fbd9f2db658368ba2feac1096d022886abd5679ae526c80 WatchSource:0}: Error finding container 4476a86534d3c78a2fbd9f2db658368ba2feac1096d022886abd5679ae526c80: Status 404 returned error can't find the container with id 4476a86534d3c78a2fbd9f2db658368ba2feac1096d022886abd5679ae526c80
Jun 03 00:49:01.781745 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.781695    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c208bf_a858_45e7_8760_800f85eb72b5.slice/crio-7e356d3beb44252120124fb87c1891c5afe823737f14045d3a614241656d8dfb WatchSource:0}: Error finding container 7e356d3beb44252120124fb87c1891c5afe823737f14045d3a614241656d8dfb: Status 404 returned error can't find the container with id 7e356d3beb44252120124fb87c1891c5afe823737f14045d3a614241656d8dfb
Jun 03 00:49:01.784744 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.784634    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2676174a_ae2c_4c9c_b960_1381fb094d19.slice/crio-15025b58058f68617ebce0128cf21e71ea1e83f5ad0562110298019b787a5d4e WatchSource:0}: Error finding container 15025b58058f68617ebce0128cf21e71ea1e83f5ad0562110298019b787a5d4e: Status 404 returned error can't find the container with id 15025b58058f68617ebce0128cf21e71ea1e83f5ad0562110298019b787a5d4e
Jun 03 00:49:01.786395 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.786377    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ede5a2_a50e_447b_8346_d6d09b0065bb.slice/crio-0f00e3021033ebfda4cf744fb2bb9e9e4991b0dbda9a294f10dc965f52d2dd4f WatchSource:0}: Error finding container 0f00e3021033ebfda4cf744fb2bb9e9e4991b0dbda9a294f10dc965f52d2dd4f: Status 404 returned error can't find the container with id 0f00e3021033ebfda4cf744fb2bb9e9e4991b0dbda9a294f10dc965f52d2dd4f
Jun 03 00:49:01.787438 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.787412    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231d2c36_0c31_4915_8eef_57b32a58c80c.slice/crio-d51905208a9a75c724b41f7eb9d0503ef111cdc3c3b442ecd2d6366dcf6f7d60 WatchSource:0}: Error finding container d51905208a9a75c724b41f7eb9d0503ef111cdc3c3b442ecd2d6366dcf6f7d60: Status 404 returned error can't find the container with id d51905208a9a75c724b41f7eb9d0503ef111cdc3c3b442ecd2d6366dcf6f7d60
Jun 03 00:49:01.788291 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.788168    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed7f138_3af8_4d0c_a009_55006ff67942.slice/crio-bd141cf4f600f070e3c17f537a511db7c7ea1c09a4e9c830ca4cc1f7c930b8a1 WatchSource:0}: Error finding container bd141cf4f600f070e3c17f537a511db7c7ea1c09a4e9c830ca4cc1f7c930b8a1: Status 404 returned error can't find the container with id bd141cf4f600f070e3c17f537a511db7c7ea1c09a4e9c830ca4cc1f7c930b8a1
Jun 03 00:49:01.790354 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.790152    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda324a5b0_5b91_43ac_9729_760253808de5.slice/crio-eff91e64c7005dc61c47f9fbfeefcdafa2d43f0cbc21b368e64c6db25105f7d0 WatchSource:0}: Error finding container eff91e64c7005dc61c47f9fbfeefcdafa2d43f0cbc21b368e64c6db25105f7d0: Status 404 returned error can't find the container with id eff91e64c7005dc61c47f9fbfeefcdafa2d43f0cbc21b368e64c6db25105f7d0
Jun 03 00:49:01.791493 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:01.791465    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfb1e82_0178_4268_8114_fadb988236ea.slice/crio-964d6853d4b634c22b7af879011a94f6a7d18fe2f9e4963050ea326c9d057dcb WatchSource:0}: Error finding container 964d6853d4b634c22b7af879011a94f6a7d18fe2f9e4963050ea326c9d057dcb: Status 404 returned error can't find the container with id 964d6853d4b634c22b7af879011a94f6a7d18fe2f9e4963050ea326c9d057dcb
Jun 03 00:49:01.946890 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:01.946689    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:01.947042 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.946849    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 00:49:01.947042 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.946972    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 00:49:01.947042 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.946986    2551 projected.go:194] Error preparing data for projected volume kube-api-access-rd2n5 for pod openshift-network-diagnostics/network-check-target-6jg28: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:01.947215 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:01.947048    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5 podName:51802faf-48c2-4861-b6b7-7ea49fffbe8b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:02.947029783 +0000 UTC m=+4.273539074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd2n5" (UniqueName: "kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5") pod "network-check-target-6jg28" (UID: "51802faf-48c2-4861-b6b7-7ea49fffbe8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:02.161653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.161610    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:44:00 +0000 UTC" deadline="2028-02-15 13:49:01.358510544 +0000 UTC"
Jun 03 00:49:02.161653 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.161642    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14940h59m59.196871877s"
Jun 03 00:49:02.219056 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.219018    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:02.219230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.219094    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:02.219230 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.219215    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:02.219762 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.219649    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:02.237248 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.237182    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7" event={"ID":"a324a5b0-5b91-43ac-9729-760253808de5","Type":"ContainerStarted","Data":"eff91e64c7005dc61c47f9fbfeefcdafa2d43f0cbc21b368e64c6db25105f7d0"}
Jun 03 00:49:02.241947 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.241886    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m9tb7" event={"ID":"286f5172-7063-473f-93fd-a2a662469b48","Type":"ContainerStarted","Data":"daa88b0f63c71ebb36294ef85d47f6040121aa0a4e192150cc089bf5bdc17b92"}
Jun 03 00:49:02.246083 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.245116    2551 generic.go:358] "Generic (PLEG): container finished" podID="685d7175fd0d9934757a21eb2bb59cd1" containerID="7b05a55403b72282b98542afcb8f3119150a09f91d489f48af03306d56222c74" exitCode=0
Jun 03 00:49:02.246083 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.245190    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal" event={"ID":"685d7175fd0d9934757a21eb2bb59cd1","Type":"ContainerDied","Data":"7b05a55403b72282b98542afcb8f3119150a09f91d489f48af03306d56222c74"}
Jun 03 00:49:02.256046 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.255552    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal" event={"ID":"cfe05e4f784b8c17aa7c181730d5d5b7","Type":"ContainerStarted","Data":"23883a6ec216b610c8aab360e9fa8c659890562102416ad06bcfd0673c33f3b7"}
Jun 03 00:49:02.270185 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.270153    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gs9t" event={"ID":"6ed7f138-3af8-4d0c-a009-55006ff67942","Type":"ContainerStarted","Data":"bd141cf4f600f070e3c17f537a511db7c7ea1c09a4e9c830ca4cc1f7c930b8a1"}
Jun 03 00:49:02.275291 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.275235    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rpt6m" event={"ID":"231d2c36-0c31-4915-8eef-57b32a58c80c","Type":"ContainerStarted","Data":"d51905208a9a75c724b41f7eb9d0503ef111cdc3c3b442ecd2d6366dcf6f7d60"}
Jun 03 00:49:02.289434 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.289392    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"0f00e3021033ebfda4cf744fb2bb9e9e4991b0dbda9a294f10dc965f52d2dd4f"}
Jun 03 00:49:02.305347 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.303747    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cgzj" event={"ID":"2676174a-ae2c-4c9c-b960-1381fb094d19","Type":"ContainerStarted","Data":"15025b58058f68617ebce0128cf21e71ea1e83f5ad0562110298019b787a5d4e"}
Jun 03 00:49:02.308264 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.308178    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgs7v" event={"ID":"88c208bf-a858-45e7-8760-800f85eb72b5","Type":"ContainerStarted","Data":"7e356d3beb44252120124fb87c1891c5afe823737f14045d3a614241656d8dfb"}
Jun 03 00:49:02.314074 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.313999    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerStarted","Data":"4476a86534d3c78a2fbd9f2db658368ba2feac1096d022886abd5679ae526c80"}
Jun 03 00:49:02.332778 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.332717    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bctwc" event={"ID":"ecfb1e82-0178-4268-8114-fadb988236ea","Type":"ContainerStarted","Data":"964d6853d4b634c22b7af879011a94f6a7d18fe2f9e4963050ea326c9d057dcb"}
Jun 03 00:49:02.760148 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.755010    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:02.760148 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.755240    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:02.760148 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.755311    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs podName:d7f27f4d-335b-47cb-b268-9df19c5d9951 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:04.755293121 +0000 UTC m=+6.081802422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs") pod "network-metrics-daemon-9b5w7" (UID: "d7f27f4d-335b-47cb-b268-9df19c5d9951") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:02.956724 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:02.956649    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:02.956956 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.956847    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 00:49:02.956956 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.956869    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 00:49:02.956956 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.956883    2551 projected.go:194] Error preparing data for projected volume kube-api-access-rd2n5 for pod openshift-network-diagnostics/network-check-target-6jg28: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:02.956956 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:02.956945    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5 podName:51802faf-48c2-4861-b6b7-7ea49fffbe8b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:04.956924395 +0000 UTC m=+6.283433686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd2n5" (UniqueName: "kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5") pod "network-check-target-6jg28" (UID: "51802faf-48c2-4861-b6b7-7ea49fffbe8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:03.365351 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:03.365269    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal" event={"ID":"685d7175fd0d9934757a21eb2bb59cd1","Type":"ContainerStarted","Data":"3128375dc6fe5d796fe9504c77b7219308deb0f012d9d756e633bc0c9ba67b2f"}
Jun 03 00:49:03.380154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:03.380099    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-62.ec2.internal" podStartSLOduration=3.380080442 podStartE2EDuration="3.380080442s" podCreationTimestamp="2026-06-03 00:49:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:02.274905184 +0000 UTC m=+3.601414492" watchObservedRunningTime="2026-06-03 00:49:03.380080442 +0000 UTC m=+4.706589751"
Jun 03 00:49:04.220215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.219342    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:04.220215 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.219479    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:04.220215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.219992    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:04.220215 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.220145    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:04.773974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.773861    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:04.774466 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.774075    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:04.774466 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.774154    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs podName:d7f27f4d-335b-47cb-b268-9df19c5d9951 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:08.77413305 +0000 UTC m=+10.100642348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs") pod "network-metrics-daemon-9b5w7" (UID: "d7f27f4d-335b-47cb-b268-9df19c5d9951") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:04.830895 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.829562    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-62.ec2.internal" podStartSLOduration=4.8295419 podStartE2EDuration="4.8295419s" podCreationTimestamp="2026-06-03 00:49:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:03.381267913 +0000 UTC m=+4.707777222" watchObservedRunningTime="2026-06-03 00:49:04.8295419 +0000 UTC m=+6.156051209"
Jun 03 00:49:04.830895 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.830141    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-p9965"]
Jun 03 00:49:04.832463 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.832065    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.832463 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.832140    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:04.875458 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.875257    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.875458 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.875316    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-kubelet-config\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.875458 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.875368    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-dbus\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.975956    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-dbus\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.976032    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.976082    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.976120    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-kubelet-config\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.976246    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-kubelet-config\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:04.976379    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-dbus\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.976496    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.976516    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.976528    2551 projected.go:194] Error preparing data for projected volume kube-api-access-rd2n5 for pod openshift-network-diagnostics/network-check-target-6jg28: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.976579    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5 podName:51802faf-48c2-4861-b6b7-7ea49fffbe8b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:08.976561808 +0000 UTC m=+10.303071109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd2n5" (UniqueName: "kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5") pod "network-check-target-6jg28" (UID: "51802faf-48c2-4861-b6b7-7ea49fffbe8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.976984    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:04.977072 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:04.977046    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret podName:8a05a34f-dfa0-4d40-bbb5-76510b09ba0b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:05.477028753 +0000 UTC m=+6.803538090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret") pod "global-pull-secret-syncer-p9965" (UID: "8a05a34f-dfa0-4d40-bbb5-76510b09ba0b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:05.481465 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:05.481376    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:05.481799 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:05.481565    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:05.481799 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:05.481637    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret podName:8a05a34f-dfa0-4d40-bbb5-76510b09ba0b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:06.481616794 +0000 UTC m=+7.808126095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret") pod "global-pull-secret-syncer-p9965" (UID: "8a05a34f-dfa0-4d40-bbb5-76510b09ba0b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:06.219688 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:06.219592    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:06.220155 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:06.219761    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:06.220155 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:06.219815    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:06.220155 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:06.219929    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:06.220155 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:06.219975    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:06.220155 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:06.220057    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:06.491831 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:06.491746    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:06.491998 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:06.491935    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:06.492071 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:06.492019    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret podName:8a05a34f-dfa0-4d40-bbb5-76510b09ba0b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:08.491991658 +0000 UTC m=+9.818500967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret") pod "global-pull-secret-syncer-p9965" (UID: "8a05a34f-dfa0-4d40-bbb5-76510b09ba0b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:08.220109 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:08.219357    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:08.220109 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:08.219497    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:08.220109 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:08.219951    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:08.220109 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:08.220046    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:08.220109 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:08.220069    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:08.220802 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:08.220122    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:08.510287 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:08.510191    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:08.510451 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:08.510365    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:08.510451 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:08.510432    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret podName:8a05a34f-dfa0-4d40-bbb5-76510b09ba0b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:12.510412385 +0000 UTC m=+13.836921676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret") pod "global-pull-secret-syncer-p9965" (UID: "8a05a34f-dfa0-4d40-bbb5-76510b09ba0b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:08.813508 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:08.813416    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:08.813695 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:08.813582    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:08.813695 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:08.813651    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs podName:d7f27f4d-335b-47cb-b268-9df19c5d9951 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:16.813630367 +0000 UTC m=+18.140139655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs") pod "network-metrics-daemon-9b5w7" (UID: "d7f27f4d-335b-47cb-b268-9df19c5d9951") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:09.015113 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:09.015075    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:09.015294 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:09.015216    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 00:49:09.015294 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:09.015237    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 00:49:09.015294 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:09.015251    2551 projected.go:194] Error preparing data for projected volume kube-api-access-rd2n5 for pod openshift-network-diagnostics/network-check-target-6jg28: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:09.015450 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:09.015313    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5 podName:51802faf-48c2-4861-b6b7-7ea49fffbe8b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:17.015295036 +0000 UTC m=+18.341804332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd2n5" (UniqueName: "kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5") pod "network-check-target-6jg28" (UID: "51802faf-48c2-4861-b6b7-7ea49fffbe8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:10.219011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:10.218940    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:10.219489 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:10.219071    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:10.219489 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:10.219420    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:10.219605 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:10.219542    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:10.219605 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:10.219591    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:10.219723 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:10.219702    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:12.219084 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:12.219046    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:12.219495 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:12.219045    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:12.219495 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:12.219164    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:12.219495 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:12.219046    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:12.219495 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:12.219243    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:12.219495 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:12.219379    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:12.544779 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:12.544700    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:12.544932 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:12.544820    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:12.544932 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:12.544884    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret podName:8a05a34f-dfa0-4d40-bbb5-76510b09ba0b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:20.544865584 +0000 UTC m=+21.871374871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret") pod "global-pull-secret-syncer-p9965" (UID: "8a05a34f-dfa0-4d40-bbb5-76510b09ba0b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:14.219061 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:14.219019    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:14.219543 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:14.219019    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:14.219543 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:14.219151    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:14.219543 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:14.219238    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:14.219543 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:14.219025    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:14.219543 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:14.219356    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:16.219809 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:16.219769    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:16.219809 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:16.219797    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:16.220357 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:16.219769    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:16.220357 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:16.219912    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:16.220357 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:16.220018    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:16.220357 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:16.220132    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:16.872892 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:16.872849    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:16.873093 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:16.873044    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:16.873166 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:16.873143    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs podName:d7f27f4d-335b-47cb-b268-9df19c5d9951 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:32.873120529 +0000 UTC m=+34.199629830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs") pod "network-metrics-daemon-9b5w7" (UID: "d7f27f4d-335b-47cb-b268-9df19c5d9951") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:17.073958 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:17.073916    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:17.074123 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:17.074107    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 00:49:17.074182 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:17.074132    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 00:49:17.074182 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:17.074146    2551 projected.go:194] Error preparing data for projected volume kube-api-access-rd2n5 for pod openshift-network-diagnostics/network-check-target-6jg28: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:17.074287 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:17.074221    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5 podName:51802faf-48c2-4861-b6b7-7ea49fffbe8b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:33.074201675 +0000 UTC m=+34.400710964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd2n5" (UniqueName: "kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5") pod "network-check-target-6jg28" (UID: "51802faf-48c2-4861-b6b7-7ea49fffbe8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:18.219453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:18.219415    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:18.219453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:18.219450    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:18.220058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:18.219468    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:18.220058 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:18.219573    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:18.220058 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:18.219638    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:18.220058 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:18.219750    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:20.219141 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.218954    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:20.219681 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.218954    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:20.219681 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:20.219228    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:20.219681 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.218954    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:20.219681 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:20.219298    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:20.219681 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:20.219394    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:20.398950 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.398921    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gs9t" event={"ID":"6ed7f138-3af8-4d0c-a009-55006ff67942","Type":"ContainerStarted","Data":"572e3a600cc0d59f81786fdcc0059d94d8f1957c8d6ee6c014a99c1e08464291"}
Jun 03 00:49:20.400195 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.400169    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rpt6m" event={"ID":"231d2c36-0c31-4915-8eef-57b32a58c80c","Type":"ContainerStarted","Data":"0c01d018ed28751636870ab5d6ea96993f9e4182ddc11df44a1b108c896f94b0"}
Jun 03 00:49:20.401477 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.401459    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"3d7a2469859c7608eab80eb38f9d2ccafec62bf9f130082de8543b203497693a"}
Jun 03 00:49:20.402615 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.402595    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cgzj" event={"ID":"2676174a-ae2c-4c9c-b960-1381fb094d19","Type":"ContainerStarted","Data":"234bef60f912940f1672d281ff63904c5b16f0417392965522238c779c133aa5"}
Jun 03 00:49:20.404048 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.404021    2551 generic.go:358] "Generic (PLEG): container finished" podID="ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a" containerID="ade10cd3b18f036c979fa9cb72340790ff013fa71d2d04f1b13cebdc33d0c059" exitCode=0
Jun 03 00:49:20.404125 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.404061    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerDied","Data":"ade10cd3b18f036c979fa9cb72340790ff013fa71d2d04f1b13cebdc33d0c059"}
Jun 03 00:49:20.405458 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.405438    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bctwc" event={"ID":"ecfb1e82-0178-4268-8114-fadb988236ea","Type":"ContainerStarted","Data":"d413355c542e5f1f11a3344c9d3b7f996a9e296128c9c0350c1a25268062cfc7"}
Jun 03 00:49:20.406948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.406899    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7" event={"ID":"a324a5b0-5b91-43ac-9729-760253808de5","Type":"ContainerStarted","Data":"acdc1e83faf43bb1d64a3d49e521106adecb73367f92045f0b370ab533454556"}
Jun 03 00:49:20.408229 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.408211    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m9tb7" event={"ID":"286f5172-7063-473f-93fd-a2a662469b48","Type":"ContainerStarted","Data":"38faa464704164a69d59e3c5a250a7b92298a1eab8d017a6f236e26f09a9e179"}
Jun 03 00:49:20.413730 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.413695    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4gs9t" podStartSLOduration=8.089179406 podStartE2EDuration="21.413685409s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.79069529 +0000 UTC m=+3.117204576" lastFinishedPulling="2026-06-03 00:49:15.115201281 +0000 UTC m=+16.441710579" observedRunningTime="2026-06-03 00:49:20.413298528 +0000 UTC m=+21.739807837" watchObservedRunningTime="2026-06-03 00:49:20.413685409 +0000 UTC m=+21.740194716"
Jun 03 00:49:20.450545 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.450481    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bctwc" podStartSLOduration=3.681302655 podStartE2EDuration="21.450465443s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.795165629 +0000 UTC m=+3.121674929" lastFinishedPulling="2026-06-03 00:49:19.564328424 +0000 UTC m=+20.890837717" observedRunningTime="2026-06-03 00:49:20.450423533 +0000 UTC m=+21.776932840" watchObservedRunningTime="2026-06-03 00:49:20.450465443 +0000 UTC m=+21.776974750"
Jun 03 00:49:20.463842 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.463795    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rpt6m" podStartSLOduration=3.752061743 podStartE2EDuration="21.463780369s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.789871655 +0000 UTC m=+3.116380939" lastFinishedPulling="2026-06-03 00:49:19.501590276 +0000 UTC m=+20.828099565" observedRunningTime="2026-06-03 00:49:20.46352802 +0000 UTC m=+21.790037329" watchObservedRunningTime="2026-06-03 00:49:20.463780369 +0000 UTC m=+21.790289677"
Jun 03 00:49:20.477954 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.477898    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-m9tb7" podStartSLOduration=3.752113424 podStartE2EDuration="21.477874394s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.781585642 +0000 UTC m=+3.108094941" lastFinishedPulling="2026-06-03 00:49:19.507346617 +0000 UTC m=+20.833855911" observedRunningTime="2026-06-03 00:49:20.477537696 +0000 UTC m=+21.804047003" watchObservedRunningTime="2026-06-03 00:49:20.477874394 +0000 UTC m=+21.804383698"
Jun 03 00:49:20.493760 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.493702    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2cgzj" podStartSLOduration=3.750177634 podStartE2EDuration="21.49368717s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.786369401 +0000 UTC m=+3.112878702" lastFinishedPulling="2026-06-03 00:49:19.529878953 +0000 UTC m=+20.856388238" observedRunningTime="2026-06-03 00:49:20.493464565 +0000 UTC m=+21.819973873" watchObservedRunningTime="2026-06-03 00:49:20.49368717 +0000 UTC m=+21.820196477"
Jun 03 00:49:20.603962 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.603813    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:20.604101 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:20.603975    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:20.604101 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:20.604070    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret podName:8a05a34f-dfa0-4d40-bbb5-76510b09ba0b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:36.604046179 +0000 UTC m=+37.930555476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret") pod "global-pull-secret-syncer-p9965" (UID: "8a05a34f-dfa0-4d40-bbb5-76510b09ba0b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 00:49:20.856258 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:20.856201    2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 00:49:21.200990 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.200836    2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T00:49:20.856223088Z","UUID":"85791602-6f7e-48db-a08d-17ab5951ccc4","Handler":null,"Name":"","Endpoint":""}
Jun 03 00:49:21.202538 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.202515    2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 00:49:21.202538 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.202543    2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 00:49:21.414389 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.414324    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"45fa056fb87790240e6d6f3acbc3887cf64efc5242adb32c6696bd2862abdfe6"}
Jun 03 00:49:21.414389 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.414367    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"864c79058aaf5e3cfad5b93aefdbc6767cdc4778194b67698d97720291a43b44"}
Jun 03 00:49:21.414389 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.414381    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"db2eff24ac55c3448c5a3b5991d028ee3e467a1a36fd42e5ff5cf6aeaa1b893d"}
Jun 03 00:49:21.414389 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.414394    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"715db112bed318cbd6bbebdf6ad3760d8591f6a3500a2fbaefee1d05325acf03"}
Jun 03 00:49:21.415417 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.414405    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"00f67ed1a25a9470aeaa50a6819c29b750e1e9835aca92c8f68cd6a297f1a006"}
Jun 03 00:49:21.416348 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.415927    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgs7v" event={"ID":"88c208bf-a858-45e7-8760-800f85eb72b5","Type":"ContainerStarted","Data":"e3f1fe1a3d6e96b005e0d7315549fc4dde519f1f3bc9a9388244c7ea158955f1"}
Jun 03 00:49:21.417918 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.417889    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7" event={"ID":"a324a5b0-5b91-43ac-9729-760253808de5","Type":"ContainerStarted","Data":"b21cd4d05245c38643f7c1559a80a01ad38dfebd59fdd13cb390bba8e638b9a6"}
Jun 03 00:49:21.430412 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.430366    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cgs7v" podStartSLOduration=4.712421065 podStartE2EDuration="22.430350549s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.783624606 +0000 UTC m=+3.110133892" lastFinishedPulling="2026-06-03 00:49:19.501554074 +0000 UTC m=+20.828063376" observedRunningTime="2026-06-03 00:49:21.429912815 +0000 UTC m=+22.756422134" watchObservedRunningTime="2026-06-03 00:49:21.430350549 +0000 UTC m=+22.756859857"
Jun 03 00:49:21.672260 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.672224    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:21.673141 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:21.672879    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:22.219935 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:22.219844    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:22.220110 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:22.219980    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:22.220110 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:22.220098    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:22.220221 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:22.219983    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:22.220221 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:22.220151    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:22.220318 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:22.220233    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:22.422247 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:22.422204    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7" event={"ID":"a324a5b0-5b91-43ac-9729-760253808de5","Type":"ContainerStarted","Data":"f6adccdaa52e4fde4d4b1cd6e0cffa4364aa1fd05db0030b87f6a69a7dfbd05a"}
Jun 03 00:49:23.428076 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:23.427841    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"b4ebbe1f426eab754ed1d34cdb640c7114f71bbeb66c547694b44faece841984"}
Jun 03 00:49:23.428076 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:23.427940    2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 00:49:24.219386 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:24.219351    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:24.219572 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:24.219351    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:24.219572 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:24.219351    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:24.219572 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:24.219488    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:24.219572 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:24.219559    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:24.219795 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:24.219655    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:25.434340 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:25.434132    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" event={"ID":"d3ede5a2-a50e-447b-8346-d6d09b0065bb","Type":"ContainerStarted","Data":"3703b8136fd1573ce958fc24752094423e8bd06f7e8095e92f4ff5c1aa5f9ede"}
Jun 03 00:49:25.435015 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:25.434469    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:25.435732 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:25.435706    2551 generic.go:358] "Generic (PLEG): container finished" podID="ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a" containerID="c9093e9eebd3fc380969c8ff5b74f7fd975f6aa4acfc070281d224eae73ca014" exitCode=0
Jun 03 00:49:25.435845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:25.435752    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerDied","Data":"c9093e9eebd3fc380969c8ff5b74f7fd975f6aa4acfc070281d224eae73ca014"}
Jun 03 00:49:25.451149 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:25.451126    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:25.461644 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:25.461605    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" podStartSLOduration=8.019810004 podStartE2EDuration="26.461593003s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.788843587 +0000 UTC m=+3.115352885" lastFinishedPulling="2026-06-03 00:49:20.230626597 +0000 UTC m=+21.557135884" observedRunningTime="2026-06-03 00:49:25.461282426 +0000 UTC m=+26.787791727" watchObservedRunningTime="2026-06-03 00:49:25.461593003 +0000 UTC m=+26.788102310"
Jun 03 00:49:25.461835 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:25.461813    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rt7g7" podStartSLOduration=6.327779007 podStartE2EDuration="26.461806448s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.792992656 +0000 UTC m=+3.119501941" lastFinishedPulling="2026-06-03 00:49:21.927020081 +0000 UTC m=+23.253529382" observedRunningTime="2026-06-03 00:49:22.44099608 +0000 UTC m=+23.767505383" watchObservedRunningTime="2026-06-03 00:49:25.461806448 +0000 UTC m=+26.788315784"
Jun 03 00:49:26.219088 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.219051    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:26.219088 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.219069    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:26.219301 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:26.219167    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:26.219301 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:26.219239    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:26.219301 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.219268    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:26.219394 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:26.219342    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:26.439427 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.439390    2551 generic.go:358] "Generic (PLEG): container finished" podID="ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a" containerID="da03c13e12fdafa4745b5e0573c701eae14e045efdf8e4168881dffb2e48b82b" exitCode=0
Jun 03 00:49:26.439838 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.439473    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerDied","Data":"da03c13e12fdafa4745b5e0573c701eae14e045efdf8e4168881dffb2e48b82b"}
Jun 03 00:49:26.439838 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.439714    2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 00:49:26.440125 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.440085    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:26.458213 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:26.458173    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:27.217225 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.217190    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6jg28"]
Jun 03 00:49:27.217393 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.217316    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:27.217466 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:27.217418    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:27.228131 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.228088    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9b5w7"]
Jun 03 00:49:27.228131 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.228132    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p9965"]
Jun 03 00:49:27.228306 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.228233    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:27.228375 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:27.228339    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:27.228712 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.228690    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:27.228822 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:27.228802    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:27.443195 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.443164    2551 generic.go:358] "Generic (PLEG): container finished" podID="ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a" containerID="aca0dced0c23bb006f3c4acd867d62d71fc0376b45097bd115bd81b9eced47fd" exitCode=0
Jun 03 00:49:27.443557 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.443256    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerDied","Data":"aca0dced0c23bb006f3c4acd867d62d71fc0376b45097bd115bd81b9eced47fd"}
Jun 03 00:49:27.443557 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:27.443443    2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 00:49:28.445483 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:28.445451    2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 00:49:29.220041 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:29.219849    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:29.220223 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:29.219891    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:29.220223 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:29.220132    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:29.220331 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:29.220214    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:29.220331 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:29.219913    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:29.220331 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:29.220308    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:30.693496 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:30.693453    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:49:30.694132 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:30.693708    2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 00:49:30.705674 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:30.705569    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" podUID="d3ede5a2-a50e-447b-8346-d6d09b0065bb" containerName="ovnkube-controller" probeResult="failure" output=""
Jun 03 00:49:30.716925 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:30.716889    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr" podUID="d3ede5a2-a50e-447b-8346-d6d09b0065bb" containerName="ovnkube-controller" probeResult="failure" output=""
Jun 03 00:49:31.220047 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:31.220008    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:31.220243 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:31.220008    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:31.220243 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:31.220140    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:31.220243 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:31.220154    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:31.220401 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:31.220252    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:31.220401 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:31.220344    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:31.435727 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:31.435693    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:31.435892 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:31.435839    2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 00:49:31.436470 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:31.436447    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4gs9t"
Jun 03 00:49:32.905569 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:32.905540    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:32.906113 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:32.905651    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:32.906113 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:32.905724    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs podName:d7f27f4d-335b-47cb-b268-9df19c5d9951 nodeName:}" failed. No retries permitted until 2026-06-03 00:50:04.905708056 +0000 UTC m=+66.232217345 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs") pod "network-metrics-daemon-9b5w7" (UID: "d7f27f4d-335b-47cb-b268-9df19c5d9951") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 00:49:33.107388 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.107363    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:33.107538 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.107519    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 00:49:33.107576 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.107544    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 00:49:33.107576 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.107554    2551 projected.go:194] Error preparing data for projected volume kube-api-access-rd2n5 for pod openshift-network-diagnostics/network-check-target-6jg28: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:33.107640 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.107602    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5 podName:51802faf-48c2-4861-b6b7-7ea49fffbe8b nodeName:}" failed. No retries permitted until 2026-06-03 00:50:05.107589036 +0000 UTC m=+66.434098322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd2n5" (UniqueName: "kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5") pod "network-check-target-6jg28" (UID: "51802faf-48c2-4861-b6b7-7ea49fffbe8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 00:49:33.218952 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.218871    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:33.219106 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.218876    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:33.219106 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.218981    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg28" podUID="51802faf-48c2-4861-b6b7-7ea49fffbe8b"
Jun 03 00:49:33.219106 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.218884    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:33.219106 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.219074    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9965" podUID="8a05a34f-dfa0-4d40-bbb5-76510b09ba0b"
Jun 03 00:49:33.219386 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.219158    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5w7" podUID="d7f27f4d-335b-47cb-b268-9df19c5d9951"
Jun 03 00:49:33.456312 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.456280    2551 generic.go:358] "Generic (PLEG): container finished" podID="ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a" containerID="96d5c60bc7b433dabae5f7039975ff1245e24bee4fa936552805b21f306fbfa1" exitCode=0
Jun 03 00:49:33.456472 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.456333    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerDied","Data":"96d5c60bc7b433dabae5f7039975ff1245e24bee4fa936552805b21f306fbfa1"}
Jun 03 00:49:33.466350 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.466330    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-62.ec2.internal" event="NodeReady"
Jun 03 00:49:33.466485 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.466472    2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 03 00:49:33.517042 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.517007    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zsdvq"]
Jun 03 00:49:33.545958 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.545922    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-srh86"]
Jun 03 00:49:33.546104 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.546087    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.549441 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.549415    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 00:49:33.549556 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.549415    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 00:49:33.549556 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.549422    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9sxhx\""
Jun 03 00:49:33.567796 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.567773    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b8c77965d-8smvp"]
Jun 03 00:49:33.567943 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.567927    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:33.573287 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.573258    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 00:49:33.573634 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.573616    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 00:49:33.573731 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.573616    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-skfr9\""
Jun 03 00:49:33.573824 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.573811    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 00:49:33.586224 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.586198    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-srh86"]
Jun 03 00:49:33.586224 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.586225    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zsdvq"]
Jun 03 00:49:33.586224 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.586233    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8c77965d-8smvp"]
Jun 03 00:49:33.586413 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.586323    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.588838 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.588819    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 00:49:33.588953 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.588821    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 00:49:33.588953 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.588880    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-svvm2\""
Jun 03 00:49:33.589095 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.589082    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 00:49:33.594612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.594593    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 00:49:33.712692 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712640    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8e66d-90f4-4041-a2cb-183a80de56ba-config-volume\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.712865 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712729    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkzq6\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-kube-api-access-kkzq6\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.712865 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712796    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:33.712865 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712818    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb46abd-544c-4931-bce2-426fe61680ff-ca-trust-extracted\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.712865 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712850    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-registry-certificates\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.713011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712867    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-trusted-ca\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.713011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712885    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smhwj\" (UniqueName: \"kubernetes.io/projected/6cc27237-ab9b-488d-bbaf-8872e280d33a-kube-api-access-smhwj\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:33.713011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712901    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.713011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712930    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5gkn\" (UniqueName: \"kubernetes.io/projected/f9e8e66d-90f4-4041-a2cb-183a80de56ba-kube-api-access-j5gkn\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.713011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712958    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.713011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712974    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-installation-pull-secrets\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.713011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.712994    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-bound-sa-token\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.713233 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.713029    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e8e66d-90f4-4041-a2cb-183a80de56ba-tmp-dir\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.713233 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.713061    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-image-registry-private-configuration\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.813444 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813360    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:33.813444 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813396    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb46abd-544c-4931-bce2-426fe61680ff-ca-trust-extracted\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.813444 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813415    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-registry-certificates\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.813444 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813433    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-trusted-ca\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813450    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smhwj\" (UniqueName: \"kubernetes.io/projected/6cc27237-ab9b-488d-bbaf-8872e280d33a-kube-api-access-smhwj\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813468    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813494    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5gkn\" (UniqueName: \"kubernetes.io/projected/f9e8e66d-90f4-4041-a2cb-183a80de56ba-kube-api-access-j5gkn\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813518    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.813518    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.813586    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.813633    2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.813593    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert podName:6cc27237-ab9b-488d-bbaf-8872e280d33a nodeName:}" failed. No retries permitted until 2026-06-03 00:49:34.313574462 +0000 UTC m=+35.640083764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert") pod "ingress-canary-srh86" (UID: "6cc27237-ab9b-488d-bbaf-8872e280d33a") : secret "canary-serving-cert" not found
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.813647    2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8c77965d-8smvp: secret "image-registry-tls" not found
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.813703    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls podName:f9e8e66d-90f4-4041-a2cb-183a80de56ba nodeName:}" failed. No retries permitted until 2026-06-03 00:49:34.313654734 +0000 UTC m=+35.640164031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls") pod "dns-default-zsdvq" (UID: "f9e8e66d-90f4-4041-a2cb-183a80de56ba") : secret "dns-default-metrics-tls" not found
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:33.813727    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls podName:cfb46abd-544c-4931-bce2-426fe61680ff nodeName:}" failed. No retries permitted until 2026-06-03 00:49:34.313714851 +0000 UTC m=+35.640224154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls") pod "image-registry-6b8c77965d-8smvp" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff") : secret "image-registry-tls" not found
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813727    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-installation-pull-secrets\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.813783 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813761    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-bound-sa-token\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813820    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e8e66d-90f4-4041-a2cb-183a80de56ba-tmp-dir\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813853    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-image-registry-private-configuration\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813904    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8e66d-90f4-4041-a2cb-183a80de56ba-config-volume\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813926    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb46abd-544c-4931-bce2-426fe61680ff-ca-trust-extracted\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.813938    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkzq6\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-kube-api-access-kkzq6\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.814141    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e8e66d-90f4-4041-a2cb-183a80de56ba-tmp-dir\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.814158    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-registry-certificates\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.814488 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.814366    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8e66d-90f4-4041-a2cb-183a80de56ba-config-volume\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.814802 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.814558    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-trusted-ca\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.817649 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.817628    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-installation-pull-secrets\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.817758 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.817695    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-image-registry-private-configuration\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.822760 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.822723    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5gkn\" (UniqueName: \"kubernetes.io/projected/f9e8e66d-90f4-4041-a2cb-183a80de56ba-kube-api-access-j5gkn\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:33.822974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.822958    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkzq6\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-kube-api-access-kkzq6\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.823028 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.822995    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-bound-sa-token\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:33.823077 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:33.823058    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smhwj\" (UniqueName: \"kubernetes.io/projected/6cc27237-ab9b-488d-bbaf-8872e280d33a-kube-api-access-smhwj\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:34.318446 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:34.318406    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:34.318446 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:34.318449    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:34.318507    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:34.318549    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:34.318612    2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:34.318630    2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8c77965d-8smvp: secret "image-registry-tls" not found
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:34.318648    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:34.318623    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls podName:f9e8e66d-90f4-4041-a2cb-183a80de56ba nodeName:}" failed. No retries permitted until 2026-06-03 00:49:35.318606512 +0000 UTC m=+36.645115800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls") pod "dns-default-zsdvq" (UID: "f9e8e66d-90f4-4041-a2cb-183a80de56ba") : secret "dns-default-metrics-tls" not found
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:34.318736    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls podName:cfb46abd-544c-4931-bce2-426fe61680ff nodeName:}" failed. No retries permitted until 2026-06-03 00:49:35.318718088 +0000 UTC m=+36.645227387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls") pod "image-registry-6b8c77965d-8smvp" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff") : secret "image-registry-tls" not found
Jun 03 00:49:34.319082 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:34.318749    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert podName:6cc27237-ab9b-488d-bbaf-8872e280d33a nodeName:}" failed. No retries permitted until 2026-06-03 00:49:35.318743376 +0000 UTC m=+36.645252660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert") pod "ingress-canary-srh86" (UID: "6cc27237-ab9b-488d-bbaf-8872e280d33a") : secret "canary-serving-cert" not found
Jun 03 00:49:34.461199 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:34.461164    2551 generic.go:358] "Generic (PLEG): container finished" podID="ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a" containerID="d8af2cc9da3fee697fa063c56b8148392ca84bab0b13f4f217259658624a4237" exitCode=0
Jun 03 00:49:34.461352 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:34.461219    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerDied","Data":"d8af2cc9da3fee697fa063c56b8148392ca84bab0b13f4f217259658624a4237"}
Jun 03 00:49:35.219236 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.219057    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:49:35.219391 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.219091    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:49:35.219442 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.219102    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:35.221980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.221961    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 00:49:35.223614 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.223593    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vkdv\""
Jun 03 00:49:35.223614 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.223608    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 00:49:35.223807 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.223623    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 00:49:35.223807 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.223652    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 00:49:35.223807 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.223741    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wvk5\""
Jun 03 00:49:35.325879 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.325848    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.325889    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.325910    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:35.325998    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:35.326008    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:35.326011    2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:35.326052    2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8c77965d-8smvp: secret "image-registry-tls" not found
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:35.326052    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert podName:6cc27237-ab9b-488d-bbaf-8872e280d33a nodeName:}" failed. No retries permitted until 2026-06-03 00:49:37.326037542 +0000 UTC m=+38.652546827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert") pod "ingress-canary-srh86" (UID: "6cc27237-ab9b-488d-bbaf-8872e280d33a") : secret "canary-serving-cert" not found
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:35.326086    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls podName:f9e8e66d-90f4-4041-a2cb-183a80de56ba nodeName:}" failed. No retries permitted until 2026-06-03 00:49:37.326074296 +0000 UTC m=+38.652583581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls") pod "dns-default-zsdvq" (UID: "f9e8e66d-90f4-4041-a2cb-183a80de56ba") : secret "dns-default-metrics-tls" not found
Jun 03 00:49:35.326264 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:35.326096    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls podName:cfb46abd-544c-4931-bce2-426fe61680ff nodeName:}" failed. No retries permitted until 2026-06-03 00:49:37.326090204 +0000 UTC m=+38.652599489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls") pod "image-registry-6b8c77965d-8smvp" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff") : secret "image-registry-tls" not found
Jun 03 00:49:35.466579 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.466548    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" event={"ID":"ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a","Type":"ContainerStarted","Data":"18c1269ed363526d1f7d72f66f2ca342564232dbf5d5565ed41f3b57e4612fed"}
Jun 03 00:49:35.487132 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:35.486992    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rl4tw" podStartSLOduration=5.363971778 podStartE2EDuration="36.486974041s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:01.782851395 +0000 UTC m=+3.109360691" lastFinishedPulling="2026-06-03 00:49:32.90585366 +0000 UTC m=+34.232362954" observedRunningTime="2026-06-03 00:49:35.486624622 +0000 UTC m=+36.813133929" watchObservedRunningTime="2026-06-03 00:49:35.486974041 +0000 UTC m=+36.813483353"
Jun 03 00:49:36.348955 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.348920    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"]
Jun 03 00:49:36.350946 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.350930    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"
Jun 03 00:49:36.353806 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.353786    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 03 00:49:36.354896 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.354875    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 03 00:49:36.354974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.354875    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wnnd2\""
Jun 03 00:49:36.361115 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.361094    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"]
Jun 03 00:49:36.534822 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.534786    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9phv2\" (UniqueName: \"kubernetes.io/projected/0213dffa-d79f-4545-94e5-9932b0cdcd08-kube-api-access-9phv2\") pod \"migrator-96c6f749-5496m\" (UID: \"0213dffa-d79f-4545-94e5-9932b0cdcd08\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"
Jun 03 00:49:36.635815 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.635723    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:36.635815 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.635773    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9phv2\" (UniqueName: \"kubernetes.io/projected/0213dffa-d79f-4545-94e5-9932b0cdcd08-kube-api-access-9phv2\") pod \"migrator-96c6f749-5496m\" (UID: \"0213dffa-d79f-4545-94e5-9932b0cdcd08\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"
Jun 03 00:49:36.638743 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.638719    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a05a34f-dfa0-4d40-bbb5-76510b09ba0b-original-pull-secret\") pod \"global-pull-secret-syncer-p9965\" (UID: \"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b\") " pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:36.643371 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.643344    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9phv2\" (UniqueName: \"kubernetes.io/projected/0213dffa-d79f-4545-94e5-9932b0cdcd08-kube-api-access-9phv2\") pod \"migrator-96c6f749-5496m\" (UID: \"0213dffa-d79f-4545-94e5-9932b0cdcd08\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"
Jun 03 00:49:36.659237 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.659219    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"
Jun 03 00:49:36.739610 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.739577    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9965"
Jun 03 00:49:36.792942 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.792914    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-5496m"]
Jun 03 00:49:36.798290 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:36.798252    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0213dffa_d79f_4545_94e5_9932b0cdcd08.slice/crio-ab68174915f0f159dddef1df86d22c642a1b1511c3ae2fb6923ad50dfbfaf386 WatchSource:0}: Error finding container ab68174915f0f159dddef1df86d22c642a1b1511c3ae2fb6923ad50dfbfaf386: Status 404 returned error can't find the container with id ab68174915f0f159dddef1df86d22c642a1b1511c3ae2fb6923ad50dfbfaf386
Jun 03 00:49:36.859877 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:36.859843    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p9965"]
Jun 03 00:49:36.863119 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:36.863091    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a05a34f_dfa0_4d40_bbb5_76510b09ba0b.slice/crio-8662151973c94f0134b5f35cd3d67488ee688f67dbe618c77944876f83ce2425 WatchSource:0}: Error finding container 8662151973c94f0134b5f35cd3d67488ee688f67dbe618c77944876f83ce2425: Status 404 returned error can't find the container with id 8662151973c94f0134b5f35cd3d67488ee688f67dbe618c77944876f83ce2425
Jun 03 00:49:37.051649 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.051572    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hdn5p"]
Jun 03 00:49:37.054300 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.054277    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.056954 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.056933    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 00:49:37.057070 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.056988    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 00:49:37.057134 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.057093    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 00:49:37.057183 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.057137    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 00:49:37.057183 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.057164    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crjds\""
Jun 03 00:49:37.063877 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.063848    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hdn5p"]
Jun 03 00:49:37.076005 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.075967    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m9tb7_286f5172-7063-473f-93fd-a2a662469b48/dns-node-resolver/0.log"
Jun 03 00:49:37.241057 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.240998    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.241238 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.241165    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r879r\" (UniqueName: \"kubernetes.io/projected/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-kube-api-access-r879r\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.241238 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.241198    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-crio-socket\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.241238 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.241225    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-data-volume\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.241363 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.241250    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.342116 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342024    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:37.342116 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342069    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r879r\" (UniqueName: \"kubernetes.io/projected/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-kube-api-access-r879r\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.342116 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342093    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-crio-socket\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342119    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342143    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-data-volume\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342165    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342190    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342196    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342224    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342263    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert podName:6cc27237-ab9b-488d-bbaf-8872e280d33a nodeName:}" failed. No retries permitted until 2026-06-03 00:49:41.342244456 +0000 UTC m=+42.668753745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert") pod "ingress-canary-srh86" (UID: "6cc27237-ab9b-488d-bbaf-8872e280d33a") : secret "canary-serving-cert" not found
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342320    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:37.342397 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342379    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls podName:6d633c5b-b1f6-4990-8ef1-7f0adb32121f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:37.842367228 +0000 UTC m=+39.168876512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hdn5p" (UID: "6d633c5b-b1f6-4990-8ef1-7f0adb32121f") : secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:37.342899 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.342526    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-crio-socket\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.342899 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342703    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 00:49:37.342899 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342744    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls podName:f9e8e66d-90f4-4041-a2cb-183a80de56ba nodeName:}" failed. No retries permitted until 2026-06-03 00:49:41.342731112 +0000 UTC m=+42.669240397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls") pod "dns-default-zsdvq" (UID: "f9e8e66d-90f4-4041-a2cb-183a80de56ba") : secret "dns-default-metrics-tls" not found
Jun 03 00:49:37.342899 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342802    2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 00:49:37.342899 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342811    2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8c77965d-8smvp: secret "image-registry-tls" not found
Jun 03 00:49:37.342899 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.342839    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls podName:cfb46abd-544c-4931-bce2-426fe61680ff nodeName:}" failed. No retries permitted until 2026-06-03 00:49:41.342830772 +0000 UTC m=+42.669340060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls") pod "image-registry-6b8c77965d-8smvp" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff") : secret "image-registry-tls" not found
Jun 03 00:49:37.343098 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.343083    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-data-volume\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.343342 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.343324    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.351716 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.351693    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r879r\" (UniqueName: \"kubernetes.io/projected/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-kube-api-access-r879r\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.471300 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.471260    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p9965" event={"ID":"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b","Type":"ContainerStarted","Data":"8662151973c94f0134b5f35cd3d67488ee688f67dbe618c77944876f83ce2425"}
Jun 03 00:49:37.472355 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.472326    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m" event={"ID":"0213dffa-d79f-4545-94e5-9932b0cdcd08","Type":"ContainerStarted","Data":"ab68174915f0f159dddef1df86d22c642a1b1511c3ae2fb6923ad50dfbfaf386"}
Jun 03 00:49:37.846517 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:37.846475    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:37.846715 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.846629    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:37.846777 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:37.846731    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls podName:6d633c5b-b1f6-4990-8ef1-7f0adb32121f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:38.846709238 +0000 UTC m=+40.173218539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hdn5p" (UID: "6d633c5b-b1f6-4990-8ef1-7f0adb32121f") : secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:38.076282 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:38.076249    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rpt6m_231d2c36-0c31-4915-8eef-57b32a58c80c/node-ca/0.log"
Jun 03 00:49:38.477102 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:38.477017    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m" event={"ID":"0213dffa-d79f-4545-94e5-9932b0cdcd08","Type":"ContainerStarted","Data":"7c61da049e2fc4320d52aceaf3d0fb45e39a75e4e096816c7ef1225c7788a63a"}
Jun 03 00:49:38.477102 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:38.477064    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m" event={"ID":"0213dffa-d79f-4545-94e5-9932b0cdcd08","Type":"ContainerStarted","Data":"debc2c411ba5e730cbfd1557a4bc4aface35331845d51be66ed76f043d86980a"}
Jun 03 00:49:38.852448 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:38.852400    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:38.852604 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:38.852586    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:38.852686 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:38.852652    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls podName:6d633c5b-b1f6-4990-8ef1-7f0adb32121f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:40.852636824 +0000 UTC m=+42.179146112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hdn5p" (UID: "6d633c5b-b1f6-4990-8ef1-7f0adb32121f") : secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:39.238357 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:39.238238    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-5496m" podStartSLOduration=1.904437536 podStartE2EDuration="3.238192199s" podCreationTimestamp="2026-06-03 00:49:36 +0000 UTC" firstStartedPulling="2026-06-03 00:49:36.801125763 +0000 UTC m=+38.127635048" lastFinishedPulling="2026-06-03 00:49:38.134880423 +0000 UTC m=+39.461389711" observedRunningTime="2026-06-03 00:49:38.515976874 +0000 UTC m=+39.842486172" watchObservedRunningTime="2026-06-03 00:49:39.238192199 +0000 UTC m=+40.564701507"
Jun 03 00:49:40.870040 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:40.869999    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:40.870511 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:40.870175    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:40.870511 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:40.870268    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls podName:6d633c5b-b1f6-4990-8ef1-7f0adb32121f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:44.870243652 +0000 UTC m=+46.196752936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hdn5p" (UID: "6d633c5b-b1f6-4990-8ef1-7f0adb32121f") : secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:41.374157 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:41.374122    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:41.374289 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:41.374185    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:41.374289 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:41.374218    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:41.374428 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:41.374285    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 00:49:41.374428 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:41.374312    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 00:49:41.374428 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:41.374358    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert podName:6cc27237-ab9b-488d-bbaf-8872e280d33a nodeName:}" failed. No retries permitted until 2026-06-03 00:49:49.374338667 +0000 UTC m=+50.700847958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert") pod "ingress-canary-srh86" (UID: "6cc27237-ab9b-488d-bbaf-8872e280d33a") : secret "canary-serving-cert" not found
Jun 03 00:49:41.374428 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:41.374372    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls podName:f9e8e66d-90f4-4041-a2cb-183a80de56ba nodeName:}" failed. No retries permitted until 2026-06-03 00:49:49.374366191 +0000 UTC m=+50.700875476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls") pod "dns-default-zsdvq" (UID: "f9e8e66d-90f4-4041-a2cb-183a80de56ba") : secret "dns-default-metrics-tls" not found
Jun 03 00:49:41.374428 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:41.374413    2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 00:49:41.374428 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:41.374428    2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8c77965d-8smvp: secret "image-registry-tls" not found
Jun 03 00:49:41.374758 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:41.374479    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls podName:cfb46abd-544c-4931-bce2-426fe61680ff nodeName:}" failed. No retries permitted until 2026-06-03 00:49:49.374459876 +0000 UTC m=+50.700969164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls") pod "image-registry-6b8c77965d-8smvp" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff") : secret "image-registry-tls" not found
Jun 03 00:49:41.484830 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:41.484792    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p9965" event={"ID":"8a05a34f-dfa0-4d40-bbb5-76510b09ba0b","Type":"ContainerStarted","Data":"f3ac8fdadb6401691cfffc413fffd081dc8356809eab3804cc7a4654e12ed7a7"}
Jun 03 00:49:41.501621 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:41.501564    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p9965" podStartSLOduration=33.036574734 podStartE2EDuration="37.501550866s" podCreationTimestamp="2026-06-03 00:49:04 +0000 UTC" firstStartedPulling="2026-06-03 00:49:36.864858862 +0000 UTC m=+38.191368146" lastFinishedPulling="2026-06-03 00:49:41.32983499 +0000 UTC m=+42.656344278" observedRunningTime="2026-06-03 00:49:41.501218077 +0000 UTC m=+42.827727384" watchObservedRunningTime="2026-06-03 00:49:41.501550866 +0000 UTC m=+42.828060172"
Jun 03 00:49:44.899913 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:44.899869    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:44.900301 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:44.900024    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:44.900301 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:49:44.900091    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls podName:6d633c5b-b1f6-4990-8ef1-7f0adb32121f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:52.900074235 +0000 UTC m=+54.226583520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hdn5p" (UID: "6d633c5b-b1f6-4990-8ef1-7f0adb32121f") : secret "insights-runtime-extractor-tls" not found
Jun 03 00:49:49.435745 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.435709    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:49.435745 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.435754    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:49.436310 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.435823    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:49.438195 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.438168    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e8e66d-90f4-4041-a2cb-183a80de56ba-metrics-tls\") pod \"dns-default-zsdvq\" (UID: \"f9e8e66d-90f4-4041-a2cb-183a80de56ba\") " pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:49.438328 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.438288    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc27237-ab9b-488d-bbaf-8872e280d33a-cert\") pod \"ingress-canary-srh86\" (UID: \"6cc27237-ab9b-488d-bbaf-8872e280d33a\") " pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:49.438428 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.438330    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"image-registry-6b8c77965d-8smvp\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") " pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:49.465625 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.465599    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:49.476360 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.476330    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-srh86"
Jun 03 00:49:49.495240 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.495209    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:49.606276 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.606247    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zsdvq"]
Jun 03 00:49:49.609639 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:49.609613    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e8e66d_90f4_4041_a2cb_183a80de56ba.slice/crio-693eacfb9156f67110db5ec38317d88cbb8ffce169779915e559471a14335fd1 WatchSource:0}: Error finding container 693eacfb9156f67110db5ec38317d88cbb8ffce169779915e559471a14335fd1: Status 404 returned error can't find the container with id 693eacfb9156f67110db5ec38317d88cbb8ffce169779915e559471a14335fd1
Jun 03 00:49:49.630023 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.627058    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-srh86"]
Jun 03 00:49:49.632832 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:49.632805    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc27237_ab9b_488d_bbaf_8872e280d33a.slice/crio-d209f098aab27b46f3f0102d53a26a4057a69fa6837a6ae0a8b8d489e0647eb6 WatchSource:0}: Error finding container d209f098aab27b46f3f0102d53a26a4057a69fa6837a6ae0a8b8d489e0647eb6: Status 404 returned error can't find the container with id d209f098aab27b46f3f0102d53a26a4057a69fa6837a6ae0a8b8d489e0647eb6
Jun 03 00:49:49.651917 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:49.651893    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8c77965d-8smvp"]
Jun 03 00:49:49.655027 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:49.654989    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb46abd_544c_4931_bce2_426fe61680ff.slice/crio-182fa6f8ac517713db78e5e1ddf97fab8e4321b6a39e9e90e87f5e82284e9afc WatchSource:0}: Error finding container 182fa6f8ac517713db78e5e1ddf97fab8e4321b6a39e9e90e87f5e82284e9afc: Status 404 returned error can't find the container with id 182fa6f8ac517713db78e5e1ddf97fab8e4321b6a39e9e90e87f5e82284e9afc
Jun 03 00:49:50.505286 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:50.505192    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp" event={"ID":"cfb46abd-544c-4931-bce2-426fe61680ff","Type":"ContainerStarted","Data":"059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c"}
Jun 03 00:49:50.505286 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:50.505234    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp" event={"ID":"cfb46abd-544c-4931-bce2-426fe61680ff","Type":"ContainerStarted","Data":"182fa6f8ac517713db78e5e1ddf97fab8e4321b6a39e9e90e87f5e82284e9afc"}
Jun 03 00:49:50.505286 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:50.505291    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:49:50.506451 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:50.506415    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsdvq" event={"ID":"f9e8e66d-90f4-4041-a2cb-183a80de56ba","Type":"ContainerStarted","Data":"693eacfb9156f67110db5ec38317d88cbb8ffce169779915e559471a14335fd1"}
Jun 03 00:49:50.507608 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:50.507578    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-srh86" event={"ID":"6cc27237-ab9b-488d-bbaf-8872e280d33a","Type":"ContainerStarted","Data":"d209f098aab27b46f3f0102d53a26a4057a69fa6837a6ae0a8b8d489e0647eb6"}
Jun 03 00:49:50.525841 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:50.525797    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp" podStartSLOduration=31.525783299 podStartE2EDuration="31.525783299s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:50.524632494 +0000 UTC m=+51.851141796" watchObservedRunningTime="2026-06-03 00:49:50.525783299 +0000 UTC m=+51.852292606"
Jun 03 00:49:52.514187 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.514148    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsdvq" event={"ID":"f9e8e66d-90f4-4041-a2cb-183a80de56ba","Type":"ContainerStarted","Data":"d8fe91ef62dc140d7e71a51487d822dbdc8b695d3963dd304d139345b56ade25"}
Jun 03 00:49:52.514187 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.514190    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsdvq" event={"ID":"f9e8e66d-90f4-4041-a2cb-183a80de56ba","Type":"ContainerStarted","Data":"837c708939109972a983de573d931c365c058cfcf3c9c095aa5786867532f728"}
Jun 03 00:49:52.514690 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.514295    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:49:52.515463 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.515444    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-srh86" event={"ID":"6cc27237-ab9b-488d-bbaf-8872e280d33a","Type":"ContainerStarted","Data":"8eb19d68c7a139d5615dcd1948fa2390cb4281eb12072c765a0c1f3d97c0a2e1"}
Jun 03 00:49:52.540203 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.540158    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-zsdvq" podStartSLOduration=17.156127166 podStartE2EDuration="19.540141583s" podCreationTimestamp="2026-06-03 00:49:33 +0000 UTC" firstStartedPulling="2026-06-03 00:49:49.611576913 +0000 UTC m=+50.938086198" lastFinishedPulling="2026-06-03 00:49:51.995591327 +0000 UTC m=+53.322100615" observedRunningTime="2026-06-03 00:49:52.538262378 +0000 UTC m=+53.864771686" watchObservedRunningTime="2026-06-03 00:49:52.540141583 +0000 UTC m=+53.866650890"
Jun 03 00:49:52.553818 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.553770    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-srh86" podStartSLOduration=17.18766415 podStartE2EDuration="19.553756084s" podCreationTimestamp="2026-06-03 00:49:33 +0000 UTC" firstStartedPulling="2026-06-03 00:49:49.635239484 +0000 UTC m=+50.961748769" lastFinishedPulling="2026-06-03 00:49:52.001331404 +0000 UTC m=+53.327840703" observedRunningTime="2026-06-03 00:49:52.553160204 +0000 UTC m=+53.879669511" watchObservedRunningTime="2026-06-03 00:49:52.553756084 +0000 UTC m=+53.880265390"
Jun 03 00:49:52.965503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.965465    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:52.967776 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:52.967754    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d633c5b-b1f6-4990-8ef1-7f0adb32121f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdn5p\" (UID: \"6d633c5b-b1f6-4990-8ef1-7f0adb32121f\") " pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:53.263977 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:53.263896    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hdn5p"
Jun 03 00:49:53.388574 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:53.388544    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hdn5p"]
Jun 03 00:49:53.391776 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:53.391744    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d633c5b_b1f6_4990_8ef1_7f0adb32121f.slice/crio-1d7dd57205cdef2435c27bad03bacddb81b0df34b862b022176f2533ec1fd2ff WatchSource:0}: Error finding container 1d7dd57205cdef2435c27bad03bacddb81b0df34b862b022176f2533ec1fd2ff: Status 404 returned error can't find the container with id 1d7dd57205cdef2435c27bad03bacddb81b0df34b862b022176f2533ec1fd2ff
Jun 03 00:49:53.519061 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:53.518996    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdn5p" event={"ID":"6d633c5b-b1f6-4990-8ef1-7f0adb32121f","Type":"ContainerStarted","Data":"1d7dd57205cdef2435c27bad03bacddb81b0df34b862b022176f2533ec1fd2ff"}
Jun 03 00:49:54.522974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:54.522946    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdn5p" event={"ID":"6d633c5b-b1f6-4990-8ef1-7f0adb32121f","Type":"ContainerStarted","Data":"62462d7e026bace971cddbb5c3f6542a32832a133f53827df4c606cdc9652fe5"}
Jun 03 00:49:55.527502 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:55.527464    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdn5p" event={"ID":"6d633c5b-b1f6-4990-8ef1-7f0adb32121f","Type":"ContainerStarted","Data":"e090551e91071c9227ed60259c1f3f7add3ad687c89f00df1d4f6c28945e09c2"}
Jun 03 00:49:56.531712 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:56.531675    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdn5p" event={"ID":"6d633c5b-b1f6-4990-8ef1-7f0adb32121f","Type":"ContainerStarted","Data":"7d14cae572de87b4da938fa99fa51319a8282c0603a7c4bad005dd35658086c8"}
Jun 03 00:49:56.570610 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:56.570554    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hdn5p" podStartSLOduration=17.31497402 podStartE2EDuration="19.57054015s" podCreationTimestamp="2026-06-03 00:49:37 +0000 UTC" firstStartedPulling="2026-06-03 00:49:53.545186698 +0000 UTC m=+54.871695982" lastFinishedPulling="2026-06-03 00:49:55.800752813 +0000 UTC m=+57.127262112" observedRunningTime="2026-06-03 00:49:56.569783702 +0000 UTC m=+57.896293011" watchObservedRunningTime="2026-06-03 00:49:56.57054015 +0000 UTC m=+57.897049457"
Jun 03 00:49:58.041066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.041034    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"]
Jun 03 00:49:58.042988 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.042972    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.045705 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.045654    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 03 00:49:58.045705 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.045676    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 03 00:49:58.046956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.046940    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 03 00:49:58.047053 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.047038    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 03 00:49:58.054924 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.054902    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"]
Jun 03 00:49:58.084293 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.084255    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b8c77965d-8smvp"]
Jun 03 00:49:58.101680 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.101630    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f29ae38-0efc-408e-86c1-1c8add8af18d-tmp\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.101847 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.101783    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f29ae38-0efc-408e-86c1-1c8add8af18d-klusterlet-config\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.101847 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.101815    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7mvc\" (UniqueName: \"kubernetes.io/projected/9f29ae38-0efc-408e-86c1-1c8add8af18d-kube-api-access-k7mvc\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.150346 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.150315    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bc474588f-ktwjb"]
Jun 03 00:49:58.152206 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.152190    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.166555 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.166531    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc474588f-ktwjb"]
Jun 03 00:49:58.203116 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203089    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f29ae38-0efc-408e-86c1-1c8add8af18d-klusterlet-config\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.203275 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203126    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8mp6\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-kube-api-access-p8mp6\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203275 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203147    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f29ae38-0efc-408e-86c1-1c8add8af18d-tmp\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.203275 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203166    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-bound-sa-token\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203275 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203185    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38d9145d-183f-4fa3-8686-9bfb4d329caf-image-registry-private-configuration\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203475 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203278    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38d9145d-183f-4fa3-8686-9bfb4d329caf-installation-pull-secrets\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203475 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203301    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-registry-tls\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203475 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203325    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38d9145d-183f-4fa3-8686-9bfb4d329caf-registry-certificates\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203475 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203397    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7mvc\" (UniqueName: \"kubernetes.io/projected/9f29ae38-0efc-408e-86c1-1c8add8af18d-kube-api-access-k7mvc\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.203645 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203487    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38d9145d-183f-4fa3-8686-9bfb4d329caf-ca-trust-extracted\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203645 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203545    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38d9145d-183f-4fa3-8686-9bfb4d329caf-trusted-ca\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.203645 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.203564    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f29ae38-0efc-408e-86c1-1c8add8af18d-tmp\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.205702 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.205681    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f29ae38-0efc-408e-86c1-1c8add8af18d-klusterlet-config\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.213691 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.213672    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7mvc\" (UniqueName: \"kubernetes.io/projected/9f29ae38-0efc-408e-86c1-1c8add8af18d-kube-api-access-k7mvc\") pod \"klusterlet-addon-workmgr-966bbf54c-cfpdn\" (UID: \"9f29ae38-0efc-408e-86c1-1c8add8af18d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.304680 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304566    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38d9145d-183f-4fa3-8686-9bfb4d329caf-trusted-ca\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.304680 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304629    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8mp6\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-kube-api-access-p8mp6\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.304881 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304745    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-bound-sa-token\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.304881 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304787    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38d9145d-183f-4fa3-8686-9bfb4d329caf-image-registry-private-configuration\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.304881 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304806    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38d9145d-183f-4fa3-8686-9bfb4d329caf-installation-pull-secrets\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.304881 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304829    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-registry-tls\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.304881 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304865    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38d9145d-183f-4fa3-8686-9bfb4d329caf-registry-certificates\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.305140 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.304913    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38d9145d-183f-4fa3-8686-9bfb4d329caf-ca-trust-extracted\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.305340 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.305319    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38d9145d-183f-4fa3-8686-9bfb4d329caf-ca-trust-extracted\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.305676 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.305647    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38d9145d-183f-4fa3-8686-9bfb4d329caf-registry-certificates\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.305756 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.305735    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38d9145d-183f-4fa3-8686-9bfb4d329caf-trusted-ca\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.307412 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.307384    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-registry-tls\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.307678 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.307649    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38d9145d-183f-4fa3-8686-9bfb4d329caf-installation-pull-secrets\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.307858 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.307835    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38d9145d-183f-4fa3-8686-9bfb4d329caf-image-registry-private-configuration\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.313678 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.313640    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8mp6\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-kube-api-access-p8mp6\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.313891 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.313874    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38d9145d-183f-4fa3-8686-9bfb4d329caf-bound-sa-token\") pod \"image-registry-7bc474588f-ktwjb\" (UID: \"38d9145d-183f-4fa3-8686-9bfb4d329caf\") " pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.352273 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.352241    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:49:58.460909 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.460877    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:58.468755 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.468723    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"]
Jun 03 00:49:58.471943 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:58.471915    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f29ae38_0efc_408e_86c1_1c8add8af18d.slice/crio-b7ae0aca2faade65e156e9226160d22d6bdbd7a2d0893ce038a0bbfc8dce4cdb WatchSource:0}: Error finding container b7ae0aca2faade65e156e9226160d22d6bdbd7a2d0893ce038a0bbfc8dce4cdb: Status 404 returned error can't find the container with id b7ae0aca2faade65e156e9226160d22d6bdbd7a2d0893ce038a0bbfc8dce4cdb
Jun 03 00:49:58.541251 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.541213    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn" event={"ID":"9f29ae38-0efc-408e-86c1-1c8add8af18d","Type":"ContainerStarted","Data":"b7ae0aca2faade65e156e9226160d22d6bdbd7a2d0893ce038a0bbfc8dce4cdb"}
Jun 03 00:49:58.580191 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:58.580004    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc474588f-ktwjb"]
Jun 03 00:49:58.582464 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:49:58.582436    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d9145d_183f_4fa3_8686_9bfb4d329caf.slice/crio-c2a9ed0880d9a420679f42957bf83cc43e16b2228f1a4fafa80c461eaa3fd3b8 WatchSource:0}: Error finding container c2a9ed0880d9a420679f42957bf83cc43e16b2228f1a4fafa80c461eaa3fd3b8: Status 404 returned error can't find the container with id c2a9ed0880d9a420679f42957bf83cc43e16b2228f1a4fafa80c461eaa3fd3b8
Jun 03 00:49:59.545418 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:59.545379    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc474588f-ktwjb" event={"ID":"38d9145d-183f-4fa3-8686-9bfb4d329caf","Type":"ContainerStarted","Data":"a25b88ec910c71c463e82f27d9e59391efd8fa68899092df069a15a0811fb9a2"}
Jun 03 00:49:59.545965 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:59.545423    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc474588f-ktwjb" event={"ID":"38d9145d-183f-4fa3-8686-9bfb4d329caf","Type":"ContainerStarted","Data":"c2a9ed0880d9a420679f42957bf83cc43e16b2228f1a4fafa80c461eaa3fd3b8"}
Jun 03 00:49:59.546041 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:59.545959    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:49:59.564196 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:49:59.564139    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bc474588f-ktwjb" podStartSLOduration=1.564122141 podStartE2EDuration="1.564122141s" podCreationTimestamp="2026-06-03 00:49:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:59.563395161 +0000 UTC m=+60.889904467" watchObservedRunningTime="2026-06-03 00:49:59.564122141 +0000 UTC m=+60.890631448"
Jun 03 00:50:00.309599 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.309559    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"]
Jun 03 00:50:00.315720 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.315688    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"
Jun 03 00:50:00.318539 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.318514    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 03 00:50:00.318702 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.318618    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pttxx\""
Jun 03 00:50:00.323430 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.323239    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"]
Jun 03 00:50:00.423466 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.423402    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67dd8746-4fb5-4ae1-8aa2-1100557cf576-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-ljd9m\" (UID: \"67dd8746-4fb5-4ae1-8aa2-1100557cf576\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"
Jun 03 00:50:00.524840 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.524711    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67dd8746-4fb5-4ae1-8aa2-1100557cf576-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-ljd9m\" (UID: \"67dd8746-4fb5-4ae1-8aa2-1100557cf576\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"
Jun 03 00:50:00.529246 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.529208    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67dd8746-4fb5-4ae1-8aa2-1100557cf576-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-ljd9m\" (UID: \"67dd8746-4fb5-4ae1-8aa2-1100557cf576\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"
Jun 03 00:50:00.628253 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.628219    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"
Jun 03 00:50:00.717131 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.717090    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmwgr"
Jun 03 00:50:00.787719 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:00.787682    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"]
Jun 03 00:50:00.790389 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:50:00.790360    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dd8746_4fb5_4ae1_8aa2_1100557cf576.slice/crio-dbbd61c466aa6da5de9b465972c5234ac39c91ff7225a417a27df6306b5e2677 WatchSource:0}: Error finding container dbbd61c466aa6da5de9b465972c5234ac39c91ff7225a417a27df6306b5e2677: Status 404 returned error can't find the container with id dbbd61c466aa6da5de9b465972c5234ac39c91ff7225a417a27df6306b5e2677
Jun 03 00:50:01.553574 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:01.553531    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m" event={"ID":"67dd8746-4fb5-4ae1-8aa2-1100557cf576","Type":"ContainerStarted","Data":"dbbd61c466aa6da5de9b465972c5234ac39c91ff7225a417a27df6306b5e2677"}
Jun 03 00:50:02.521693 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:02.521649    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zsdvq"
Jun 03 00:50:02.558156 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:02.558116    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn" event={"ID":"9f29ae38-0efc-408e-86c1-1c8add8af18d","Type":"ContainerStarted","Data":"0ca42b07c0c61caed860df9b346c05443473d61033662d499124f3c9728e646e"}
Jun 03 00:50:02.558395 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:02.558360    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:50:02.560151 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:02.560129    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn"
Jun 03 00:50:02.573096 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:02.573037    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-966bbf54c-cfpdn" podStartSLOduration=1.012365079 podStartE2EDuration="4.573020638s" podCreationTimestamp="2026-06-03 00:49:58 +0000 UTC" firstStartedPulling="2026-06-03 00:49:58.473589454 +0000 UTC m=+59.800098739" lastFinishedPulling="2026-06-03 00:50:02.034245007 +0000 UTC m=+63.360754298" observedRunningTime="2026-06-03 00:50:02.572382259 +0000 UTC m=+63.898891566" watchObservedRunningTime="2026-06-03 00:50:02.573020638 +0000 UTC m=+63.899529946"
Jun 03 00:50:03.562374 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:03.562334    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m" event={"ID":"67dd8746-4fb5-4ae1-8aa2-1100557cf576","Type":"ContainerStarted","Data":"c7eb63e23b790294ba8f3cdf15729e8efeddbc352b115278e7f18d7dc1f914f9"}
Jun 03 00:50:03.562875 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:03.562608    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"
Jun 03 00:50:03.567335 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:03.567311    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m"
Jun 03 00:50:03.576921 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:03.576881    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ljd9m" podStartSLOduration=1.4685450150000001 podStartE2EDuration="3.576870328s" podCreationTimestamp="2026-06-03 00:50:00 +0000 UTC" firstStartedPulling="2026-06-03 00:50:00.792813784 +0000 UTC m=+62.119323084" lastFinishedPulling="2026-06-03 00:50:02.901139109 +0000 UTC m=+64.227648397" observedRunningTime="2026-06-03 00:50:03.576232374 +0000 UTC m=+64.902741680" watchObservedRunningTime="2026-06-03 00:50:03.576870328 +0000 UTC m=+64.903379634"
Jun 03 00:50:04.371771 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.371731    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"]
Jun 03 00:50:04.374638 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.374622    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.377478 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.377447    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 00:50:04.377600 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.377449    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 03 00:50:04.377600 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.377447    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lfscc\""
Jun 03 00:50:04.377600 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.377453    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 00:50:04.377726 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.377447    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 03 00:50:04.378682 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.378649    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 00:50:04.382251 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.382230    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"]
Jun 03 00:50:04.456612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.456565    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.456612 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.456614    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb7da751-ec11-450f-8b73-20fa697e7fcb-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.456836 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.456639    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.456836 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.456684    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8l9\" (UniqueName: \"kubernetes.io/projected/fb7da751-ec11-450f-8b73-20fa697e7fcb-kube-api-access-jh8l9\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.557057 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.557019    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb7da751-ec11-450f-8b73-20fa697e7fcb-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.557057 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.557058    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.557301 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.557080    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8l9\" (UniqueName: \"kubernetes.io/projected/fb7da751-ec11-450f-8b73-20fa697e7fcb-kube-api-access-jh8l9\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.557301 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.557158    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.557301 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:50:04.557259    2551 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 03 00:50:04.557462 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:50:04.557325    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-tls podName:fb7da751-ec11-450f-8b73-20fa697e7fcb nodeName:}" failed. No retries permitted until 2026-06-03 00:50:05.057305558 +0000 UTC m=+66.383814857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-m6cdk" (UID: "fb7da751-ec11-450f-8b73-20fa697e7fcb") : secret "prometheus-operator-tls" not found
Jun 03 00:50:04.557752 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.557734    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb7da751-ec11-450f-8b73-20fa697e7fcb-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.559630 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.559604    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.566136 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.566107    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8l9\" (UniqueName: \"kubernetes.io/projected/fb7da751-ec11-450f-8b73-20fa697e7fcb-kube-api-access-jh8l9\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:04.960841 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.960805    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:50:04.963619 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.963596    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 00:50:04.973933 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:04.973910    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f27f4d-335b-47cb-b268-9df19c5d9951-metrics-certs\") pod \"network-metrics-daemon-9b5w7\" (UID: \"d7f27f4d-335b-47cb-b268-9df19c5d9951\") " pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:50:05.062185 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.062148    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:05.064514 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.064484    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb7da751-ec11-450f-8b73-20fa697e7fcb-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-m6cdk\" (UID: \"fb7da751-ec11-450f-8b73-20fa697e7fcb\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:05.163101 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.163059    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:50:05.165938 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.165919    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 00:50:05.176597 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.176573    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 00:50:05.187287 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.187252    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd2n5\" (UniqueName: \"kubernetes.io/projected/51802faf-48c2-4861-b6b7-7ea49fffbe8b-kube-api-access-rd2n5\") pod \"network-check-target-6jg28\" (UID: \"51802faf-48c2-4861-b6b7-7ea49fffbe8b\") " pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:50:05.232277 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.232202    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wvk5\""
Jun 03 00:50:05.237890 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.237864    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vkdv\""
Jun 03 00:50:05.239830 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.239813    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:50:05.246474 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.246447    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5w7"
Jun 03 00:50:05.283460 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.283423    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"
Jun 03 00:50:05.389414 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.389353    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6jg28"]
Jun 03 00:50:05.391557 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:50:05.391530    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51802faf_48c2_4861_b6b7_7ea49fffbe8b.slice/crio-8cc1b2e47b54066d996794ee6fcce1f055b2f19a5f211d2a6d7c84fe661c7b30 WatchSource:0}: Error finding container 8cc1b2e47b54066d996794ee6fcce1f055b2f19a5f211d2a6d7c84fe661c7b30: Status 404 returned error can't find the container with id 8cc1b2e47b54066d996794ee6fcce1f055b2f19a5f211d2a6d7c84fe661c7b30
Jun 03 00:50:05.414585 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.414518    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9b5w7"]
Jun 03 00:50:05.417142 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:50:05.417103    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f27f4d_335b_47cb_b268_9df19c5d9951.slice/crio-bea608b66f3bb96a1c0705a55fc0a78091db523d83b38972eb51cdbaca854c4b WatchSource:0}: Error finding container bea608b66f3bb96a1c0705a55fc0a78091db523d83b38972eb51cdbaca854c4b: Status 404 returned error can't find the container with id bea608b66f3bb96a1c0705a55fc0a78091db523d83b38972eb51cdbaca854c4b
Jun 03 00:50:05.443724 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.443694    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk"]
Jun 03 00:50:05.447013 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:50:05.446990    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7da751_ec11_450f_8b73_20fa697e7fcb.slice/crio-6971b6059fe22b2263ff2c9db8b062d556961fe6e805c6de68b18ee6d6c7c26d WatchSource:0}: Error finding container 6971b6059fe22b2263ff2c9db8b062d556961fe6e805c6de68b18ee6d6c7c26d: Status 404 returned error can't find the container with id 6971b6059fe22b2263ff2c9db8b062d556961fe6e805c6de68b18ee6d6c7c26d
Jun 03 00:50:05.569012 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.568923    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk" event={"ID":"fb7da751-ec11-450f-8b73-20fa697e7fcb","Type":"ContainerStarted","Data":"6971b6059fe22b2263ff2c9db8b062d556961fe6e805c6de68b18ee6d6c7c26d"}
Jun 03 00:50:05.570267 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.570241    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6jg28" event={"ID":"51802faf-48c2-4861-b6b7-7ea49fffbe8b","Type":"ContainerStarted","Data":"8cc1b2e47b54066d996794ee6fcce1f055b2f19a5f211d2a6d7c84fe661c7b30"}
Jun 03 00:50:05.571350 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:05.571330    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b5w7" event={"ID":"d7f27f4d-335b-47cb-b268-9df19c5d9951","Type":"ContainerStarted","Data":"bea608b66f3bb96a1c0705a55fc0a78091db523d83b38972eb51cdbaca854c4b"}
Jun 03 00:50:08.090631 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.090532    2551 patch_prober.go:28] interesting pod/image-registry-6b8c77965d-8smvp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 00:50:08.090631 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.090589    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp" podUID="cfb46abd-544c-4931-bce2-426fe61680ff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 00:50:08.586102 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.586067    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk" event={"ID":"fb7da751-ec11-450f-8b73-20fa697e7fcb","Type":"ContainerStarted","Data":"4652e63935395c84f5ca26887f5e3070a512b3bf9239af19e6bfba50feca0ec7"}
Jun 03 00:50:08.586102 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.586107    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk" event={"ID":"fb7da751-ec11-450f-8b73-20fa697e7fcb","Type":"ContainerStarted","Data":"43cba04b9be13edc4cd422a2ad5d1baaa61fe80dee1eabfae17f79a830fff779"}
Jun 03 00:50:08.587777 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.587742    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b5w7" event={"ID":"d7f27f4d-335b-47cb-b268-9df19c5d9951","Type":"ContainerStarted","Data":"27696de3363f34c3b9f0486b68d4b5dbaa4e076806faf4d5a9f4b8204dc97e15"}
Jun 03 00:50:08.587954 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.587782    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b5w7" event={"ID":"d7f27f4d-335b-47cb-b268-9df19c5d9951","Type":"ContainerStarted","Data":"f8f5dc7b0e7cbb6061b2c1050965e68a10a29eed0bc37251bcb007b406c50fa3"}
Jun 03 00:50:08.603147 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.603072    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-m6cdk" podStartSLOduration=2.56108364 podStartE2EDuration="4.60305414s" podCreationTimestamp="2026-06-03 00:50:04 +0000 UTC" firstStartedPulling="2026-06-03 00:50:05.44894232 +0000 UTC m=+66.775451606" lastFinishedPulling="2026-06-03 00:50:07.490912818 +0000 UTC m=+68.817422106" observedRunningTime="2026-06-03 00:50:08.602305386 +0000 UTC m=+69.928814694" watchObservedRunningTime="2026-06-03 00:50:08.60305414 +0000 UTC m=+69.929563450"
Jun 03 00:50:08.616585 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:08.616506    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9b5w7" podStartSLOduration=67.547442036 podStartE2EDuration="1m9.616486465s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:50:05.419228707 +0000 UTC m=+66.745737993" lastFinishedPulling="2026-06-03 00:50:07.488273128 +0000 UTC m=+68.814782422" observedRunningTime="2026-06-03 00:50:08.615995601 +0000 UTC m=+69.942504909" watchObservedRunningTime="2026-06-03 00:50:08.616486465 +0000 UTC m=+69.942995773"
Jun 03 00:50:09.591041 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:09.590993    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6jg28" event={"ID":"51802faf-48c2-4861-b6b7-7ea49fffbe8b","Type":"ContainerStarted","Data":"146b205f3be0459bf8edd971d540d913246336d03d59cf86753ff0d2f6124908"}
Jun 03 00:50:09.606833 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:09.606777    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6jg28" podStartSLOduration=67.0484043 podStartE2EDuration="1m10.606763456s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:50:05.394036946 +0000 UTC m=+66.720546230" lastFinishedPulling="2026-06-03 00:50:08.952396098 +0000 UTC m=+70.278905386" observedRunningTime="2026-06-03 00:50:09.60493065 +0000 UTC m=+70.931439957" watchObservedRunningTime="2026-06-03 00:50:09.606763456 +0000 UTC m=+70.933272783"
Jun 03 00:50:10.596098 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.596062    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:50:10.722004 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.721973    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cdh25"]
Jun 03 00:50:10.724089 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.724073    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.727221 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.727193    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 03 00:50:10.727221 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.727210    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-67lf4\""
Jun 03 00:50:10.727374 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.727248    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 03 00:50:10.739688 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.739647    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cdh25"]
Jun 03 00:50:10.775325 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.775293    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h79cb"]
Jun 03 00:50:10.777491 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.777474    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.780166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.780144    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 00:50:10.780271 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.780178    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 00:50:10.780516 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.780498    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7drv6\""
Jun 03 00:50:10.781403 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.781390    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 00:50:10.808383 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.808352    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7747d9e-8399-46de-aaea-29dad01ec682-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.808383 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.808394    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slqn2\" (UniqueName: \"kubernetes.io/projected/e7747d9e-8399-46de-aaea-29dad01ec682-kube-api-access-slqn2\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.808590 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.808417    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.808590 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.808490    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.909690 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909627    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.909690 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909695    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-tls\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.909956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909717    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-textfile\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.909956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909735    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-metrics-client-ca\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.909956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909757    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-root\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.909956 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:50:10.909778    2551 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 03 00:50:10.909956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909843    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-wtmp\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.909956 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:50:10.909863    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-tls podName:e7747d9e-8399-46de-aaea-29dad01ec682 nodeName:}" failed. No retries permitted until 2026-06-03 00:50:11.409842187 +0000 UTC m=+72.736351474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-cdh25" (UID: "e7747d9e-8399-46de-aaea-29dad01ec682") : secret "openshift-state-metrics-tls" not found
Jun 03 00:50:10.909956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909907    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.910257 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909964    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-sys\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.910257 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.909990    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.910257 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.910050    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7747d9e-8399-46de-aaea-29dad01ec682-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.910257 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.910077    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfv6r\" (UniqueName: \"kubernetes.io/projected/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-kube-api-access-cfv6r\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:10.910257 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.910130    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-slqn2\" (UniqueName: \"kubernetes.io/projected/e7747d9e-8399-46de-aaea-29dad01ec682-kube-api-access-slqn2\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.910257 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.910154    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.910609 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.910591    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7747d9e-8399-46de-aaea-29dad01ec682-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.912593 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.912576    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:10.918746 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:10.918725    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slqn2\" (UniqueName: \"kubernetes.io/projected/e7747d9e-8399-46de-aaea-29dad01ec682-kube-api-access-slqn2\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:11.010707 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010640    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-sys\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010707 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010708    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010735    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfv6r\" (UniqueName: \"kubernetes.io/projected/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-kube-api-access-cfv6r\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010749    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-sys\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010814    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-tls\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010834    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-textfile\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010853    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-metrics-client-ca\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010888    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-root\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010924    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-wtmp\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.010974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010949    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.011330 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.010978    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-root\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.011330 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.011110    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-wtmp\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.011330 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.011212    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-textfile\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.011469 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.011451    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-metrics-client-ca\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.011537 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.011518    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.013166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.013145    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-tls\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.013268 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.013196    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.017931 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.017907    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfv6r\" (UniqueName: \"kubernetes.io/projected/ef3d0d78-6dc0-4944-b5d5-10e0530141ba-kube-api-access-cfv6r\") pod \"node-exporter-h79cb\" (UID: \"ef3d0d78-6dc0-4944-b5d5-10e0530141ba\") " pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.086058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.086024    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h79cb"
Jun 03 00:50:11.094923 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:50:11.094886    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3d0d78_6dc0_4944_b5d5_10e0530141ba.slice/crio-a2ce0051e9a2f59b089ad8a639cde912c705cc3fbc3de310f529549dd9bdf6f0 WatchSource:0}: Error finding container a2ce0051e9a2f59b089ad8a639cde912c705cc3fbc3de310f529549dd9bdf6f0: Status 404 returned error can't find the container with id a2ce0051e9a2f59b089ad8a639cde912c705cc3fbc3de310f529549dd9bdf6f0
Jun 03 00:50:11.414839 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.414791    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:11.417133 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.417114    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7747d9e-8399-46de-aaea-29dad01ec682-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cdh25\" (UID: \"e7747d9e-8399-46de-aaea-29dad01ec682\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:11.599230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.599194    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h79cb" event={"ID":"ef3d0d78-6dc0-4944-b5d5-10e0530141ba","Type":"ContainerStarted","Data":"a2ce0051e9a2f59b089ad8a639cde912c705cc3fbc3de310f529549dd9bdf6f0"}
Jun 03 00:50:11.633003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.632961    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25"
Jun 03 00:50:11.784947 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:11.784889    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cdh25"]
Jun 03 00:50:12.604323 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:12.604218    2551 generic.go:358] "Generic (PLEG): container finished" podID="ef3d0d78-6dc0-4944-b5d5-10e0530141ba" containerID="d27767d19056c764c613357e886b043ecef38db828cd4f72df8c159ddc9b70d7" exitCode=0
Jun 03 00:50:12.604800 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:12.604432    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h79cb" event={"ID":"ef3d0d78-6dc0-4944-b5d5-10e0530141ba","Type":"ContainerDied","Data":"d27767d19056c764c613357e886b043ecef38db828cd4f72df8c159ddc9b70d7"}
Jun 03 00:50:12.606447 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:12.606413    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25" event={"ID":"e7747d9e-8399-46de-aaea-29dad01ec682","Type":"ContainerStarted","Data":"e2cd1ed92c27ba49c48fb50a26eb9a2b4b65ebfcf75b2260e7db878ccc0b699e"}
Jun 03 00:50:12.606564 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:12.606454    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25" event={"ID":"e7747d9e-8399-46de-aaea-29dad01ec682","Type":"ContainerStarted","Data":"e2b217502b3d59797bff4a38d502d22d313b53b0af54ce1b02a4adf8f82ebe4a"}
Jun 03 00:50:12.606564 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:12.606470    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25" event={"ID":"e7747d9e-8399-46de-aaea-29dad01ec682","Type":"ContainerStarted","Data":"933fb22151146291fccf37c257974aee2bd412c18aea1bfadf5fc3209ee0d386"}
Jun 03 00:50:13.611301 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:13.611262    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25" event={"ID":"e7747d9e-8399-46de-aaea-29dad01ec682","Type":"ContainerStarted","Data":"08ff2c453f9931b78166703394bae98e3ebf585c4601e856ba4b964a223734e5"}
Jun 03 00:50:13.613221 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:13.613188    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h79cb" event={"ID":"ef3d0d78-6dc0-4944-b5d5-10e0530141ba","Type":"ContainerStarted","Data":"cbfe872e185318839766d6e35e9776e46ba2cabb3a6f3207551e7f0b99f5646b"}
Jun 03 00:50:13.613221 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:13.613226    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h79cb" event={"ID":"ef3d0d78-6dc0-4944-b5d5-10e0530141ba","Type":"ContainerStarted","Data":"884fff8c38738ead3d8d220d323aadbb30b89e738e8efcf56a5a517c04a1b8e7"}
Jun 03 00:50:13.631742 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:13.631649    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-cdh25" podStartSLOduration=2.56611485 podStartE2EDuration="3.631630126s" podCreationTimestamp="2026-06-03 00:50:10 +0000 UTC" firstStartedPulling="2026-06-03 00:50:11.922334131 +0000 UTC m=+73.248843423" lastFinishedPulling="2026-06-03 00:50:12.987849409 +0000 UTC m=+74.314358699" observedRunningTime="2026-06-03 00:50:13.629649069 +0000 UTC m=+74.956158377" watchObservedRunningTime="2026-06-03 00:50:13.631630126 +0000 UTC m=+74.958139434"
Jun 03 00:50:13.649248 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:13.649198    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h79cb" podStartSLOduration=2.639456194 podStartE2EDuration="3.649180819s" podCreationTimestamp="2026-06-03 00:50:10 +0000 UTC" firstStartedPulling="2026-06-03 00:50:11.096859019 +0000 UTC m=+72.423368304" lastFinishedPulling="2026-06-03 00:50:12.106583629 +0000 UTC m=+73.433092929" observedRunningTime="2026-06-03 00:50:13.647889857 +0000 UTC m=+74.974399164" watchObservedRunningTime="2026-06-03 00:50:13.649180819 +0000 UTC m=+74.975690125"
Jun 03 00:50:15.152649 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.152616    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66778f6cd5-jcw8n"]
Jun 03 00:50:15.173233 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.173204    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66778f6cd5-jcw8n"]
Jun 03 00:50:15.173378 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.173321    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.177262 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.177235    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4kmjf\""
Jun 03 00:50:15.177262 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.177251    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 03 00:50:15.177484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.177253    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 03 00:50:15.177484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.177295    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 00:50:15.177484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.177380    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 03 00:50:15.177655 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.177553    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-erql8pp4fn7o2\""
Jun 03 00:50:15.248980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.248940    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8rlh\" (UniqueName: \"kubernetes.io/projected/8412f819-c058-46b9-96d3-1e6f57e4d6e2-kube-api-access-t8rlh\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.249163 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.248988    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-client-ca-bundle\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.249163 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.249026    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-secret-metrics-server-tls\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.249163 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.249107    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-secret-metrics-server-client-certs\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.249163 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.249141    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8412f819-c058-46b9-96d3-1e6f57e4d6e2-metrics-server-audit-profiles\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.249163 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.249158    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8412f819-c058-46b9-96d3-1e6f57e4d6e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.249351 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.249210    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8412f819-c058-46b9-96d3-1e6f57e4d6e2-audit-log\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.350312 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350272    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-secret-metrics-server-client-certs\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.350312 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350316    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8412f819-c058-46b9-96d3-1e6f57e4d6e2-metrics-server-audit-profiles\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.350571 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350335    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8412f819-c058-46b9-96d3-1e6f57e4d6e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.350571 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350376    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8412f819-c058-46b9-96d3-1e6f57e4d6e2-audit-log\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.350571 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350412    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8rlh\" (UniqueName: \"kubernetes.io/projected/8412f819-c058-46b9-96d3-1e6f57e4d6e2-kube-api-access-t8rlh\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.350571 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350449    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-client-ca-bundle\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.350571 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350485    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-secret-metrics-server-tls\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.351004 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.350970    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8412f819-c058-46b9-96d3-1e6f57e4d6e2-audit-log\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.351303 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.351279    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8412f819-c058-46b9-96d3-1e6f57e4d6e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.351404 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.351379    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8412f819-c058-46b9-96d3-1e6f57e4d6e2-metrics-server-audit-profiles\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.352895 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.352862    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-client-ca-bundle\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.353007 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.352899    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-secret-metrics-server-tls\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.353074 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.353024    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8412f819-c058-46b9-96d3-1e6f57e4d6e2-secret-metrics-server-client-certs\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.358303 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.358282    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8rlh\" (UniqueName: \"kubernetes.io/projected/8412f819-c058-46b9-96d3-1e6f57e4d6e2-kube-api-access-t8rlh\") pod \"metrics-server-66778f6cd5-jcw8n\" (UID: \"8412f819-c058-46b9-96d3-1e6f57e4d6e2\") " pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.482945 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.482864    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:15.611493 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.611464    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66778f6cd5-jcw8n"]
Jun 03 00:50:15.614696 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:50:15.614646    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8412f819_c058_46b9_96d3_1e6f57e4d6e2.slice/crio-10792a94bd415241b7d5028b422b8f5af46d79136527a9e3ac1b99a775601cbc WatchSource:0}: Error finding container 10792a94bd415241b7d5028b422b8f5af46d79136527a9e3ac1b99a775601cbc: Status 404 returned error can't find the container with id 10792a94bd415241b7d5028b422b8f5af46d79136527a9e3ac1b99a775601cbc
Jun 03 00:50:15.619353 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:15.619290    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n" event={"ID":"8412f819-c058-46b9-96d3-1e6f57e4d6e2","Type":"ContainerStarted","Data":"10792a94bd415241b7d5028b422b8f5af46d79136527a9e3ac1b99a775601cbc"}
Jun 03 00:50:18.088579 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:18.088504    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:50:18.629624 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:18.629585    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n" event={"ID":"8412f819-c058-46b9-96d3-1e6f57e4d6e2","Type":"ContainerStarted","Data":"d544e374deaeab5d9bbb2799f2901cbd170c9e7c9ae83a34717e463fb15c93f9"}
Jun 03 00:50:18.647479 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:18.647025    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n" podStartSLOduration=1.643913634 podStartE2EDuration="3.64700683s" podCreationTimestamp="2026-06-03 00:50:15 +0000 UTC" firstStartedPulling="2026-06-03 00:50:15.616743943 +0000 UTC m=+76.943253228" lastFinishedPulling="2026-06-03 00:50:17.61983713 +0000 UTC m=+78.946346424" observedRunningTime="2026-06-03 00:50:18.645517191 +0000 UTC m=+79.972026497" watchObservedRunningTime="2026-06-03 00:50:18.64700683 +0000 UTC m=+79.973516137"
Jun 03 00:50:20.552495 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:20.552466    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bc474588f-ktwjb"
Jun 03 00:50:22.337652 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.337610    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79785956d-ncmht"]
Jun 03 00:50:22.341275 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.341253    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.343854 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.343824    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 03 00:50:22.343854 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.343842    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 03 00:50:22.345130 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.345113    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 03 00:50:22.345214 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.345196    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8c7jt\""
Jun 03 00:50:22.345359 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.345343    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 03 00:50:22.345466 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.345445    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 03 00:50:22.345606 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.345600    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 03 00:50:22.345693 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.345643    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 03 00:50:22.350525 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.350507    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 03 00:50:22.351148 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.351127    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79785956d-ncmht"]
Jun 03 00:50:22.518590 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.518550    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-serving-cert\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.518789 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.518608    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-config\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.518863 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.518785    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-trusted-ca-bundle\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.518863 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.518814    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-service-ca\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.518863 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.518839    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-oauth-serving-cert\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.518969 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.518867    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pddk\" (UniqueName: \"kubernetes.io/projected/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-kube-api-access-2pddk\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.518969 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.518897    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-oauth-config\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.619684 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.619630    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-serving-cert\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.619845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.619698    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-config\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.619845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.619730    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-trusted-ca-bundle\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.619845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.619753    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-service-ca\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.619845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.619777    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-oauth-serving-cert\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.619845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.619809    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pddk\" (UniqueName: \"kubernetes.io/projected/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-kube-api-access-2pddk\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.619845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.619837    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-oauth-config\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.620554 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.620528    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-oauth-serving-cert\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.620694 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.620609    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-service-ca\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.620694 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.620640    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-config\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.620996 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.620973    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-trusted-ca-bundle\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.622217 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.622190    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-serving-cert\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.622370 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.622353    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-oauth-config\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.627994 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.627968    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pddk\" (UniqueName: \"kubernetes.io/projected/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-kube-api-access-2pddk\") pod \"console-79785956d-ncmht\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") " pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.651503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.651467    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:22.787026 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:22.786989    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79785956d-ncmht"]
Jun 03 00:50:22.791797 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:50:22.791768    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc795ce5b_e5d9_49f0_aeb7_ebb0d036face.slice/crio-138c69a2c660e99267016457d1d7cab9e8ab0d3ab4507d36c331a715156801bf WatchSource:0}: Error finding container 138c69a2c660e99267016457d1d7cab9e8ab0d3ab4507d36c331a715156801bf: Status 404 returned error can't find the container with id 138c69a2c660e99267016457d1d7cab9e8ab0d3ab4507d36c331a715156801bf
Jun 03 00:50:23.104314 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.104246    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp" podUID="cfb46abd-544c-4931-bce2-426fe61680ff" containerName="registry" containerID="cri-o://059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c" gracePeriod=30
Jun 03 00:50:23.336146 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.336117    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:50:23.429228 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429140    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-registry-certificates\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429228 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429180    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-trusted-ca\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429228 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429223    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-installation-pull-secrets\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429808 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429244    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429808 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429260    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-bound-sa-token\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429808 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429313    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-image-registry-private-configuration\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429808 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429331    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkzq6\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-kube-api-access-kkzq6\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429808 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429372    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb46abd-544c-4931-bce2-426fe61680ff-ca-trust-extracted\") pod \"cfb46abd-544c-4931-bce2-426fe61680ff\" (UID: \"cfb46abd-544c-4931-bce2-426fe61680ff\") "
Jun 03 00:50:23.429808 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429730    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:50:23.430096 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.429869    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:50:23.432506 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.432455    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-kube-api-access-kkzq6" (OuterVolumeSpecName: "kube-api-access-kkzq6") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "kube-api-access-kkzq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:50:23.432752 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.432706    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:50:23.433204 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.433175    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:50:23.433204 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.433188    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:50:23.433204 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.433200    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:50:23.440002 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.439958    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb46abd-544c-4931-bce2-426fe61680ff-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cfb46abd-544c-4931-bce2-426fe61680ff" (UID: "cfb46abd-544c-4931-bce2-426fe61680ff"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:50:23.530010 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.529972    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkzq6\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-kube-api-access-kkzq6\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.530010 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.530005    2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb46abd-544c-4931-bce2-426fe61680ff-ca-trust-extracted\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.530230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.530020    2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-registry-certificates\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.530230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.530036    2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb46abd-544c-4931-bce2-426fe61680ff-trusted-ca\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.530230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.530050    2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-installation-pull-secrets\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.530230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.530059    2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-registry-tls\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.530230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.530069    2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb46abd-544c-4931-bce2-426fe61680ff-bound-sa-token\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.530230 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.530079    2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb46abd-544c-4931-bce2-426fe61680ff-image-registry-private-configuration\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:50:23.644244 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.644207    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79785956d-ncmht" event={"ID":"c795ce5b-e5d9-49f0-aeb7-ebb0d036face","Type":"ContainerStarted","Data":"138c69a2c660e99267016457d1d7cab9e8ab0d3ab4507d36c331a715156801bf"}
Jun 03 00:50:23.645458 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.645427    2551 generic.go:358] "Generic (PLEG): container finished" podID="cfb46abd-544c-4931-bce2-426fe61680ff" containerID="059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c" exitCode=0
Jun 03 00:50:23.645582 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.645499    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp" event={"ID":"cfb46abd-544c-4931-bce2-426fe61680ff","Type":"ContainerDied","Data":"059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c"}
Jun 03 00:50:23.645582 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.645505    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp"
Jun 03 00:50:23.645582 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.645528    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8c77965d-8smvp" event={"ID":"cfb46abd-544c-4931-bce2-426fe61680ff","Type":"ContainerDied","Data":"182fa6f8ac517713db78e5e1ddf97fab8e4321b6a39e9e90e87f5e82284e9afc"}
Jun 03 00:50:23.645582 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.645543    2551 scope.go:117] "RemoveContainer" containerID="059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c"
Jun 03 00:50:23.654463 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.654351    2551 scope.go:117] "RemoveContainer" containerID="059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c"
Jun 03 00:50:23.654784 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:50:23.654685    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c\": container with ID starting with 059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c not found: ID does not exist" containerID="059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c"
Jun 03 00:50:23.654784 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.654717    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c"} err="failed to get container status \"059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c\": rpc error: code = NotFound desc = could not find container \"059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c\": container with ID starting with 059bc73aacd49109788067c03e61d247077b5794b42b41bb88cdf27e83dbd40c not found: ID does not exist"
Jun 03 00:50:23.668364 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.668339    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b8c77965d-8smvp"]
Jun 03 00:50:23.674055 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:23.674029    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b8c77965d-8smvp"]
Jun 03 00:50:25.224065 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:25.224018    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfb46abd-544c-4931-bce2-426fe61680ff" path="/var/lib/kubelet/pods/cfb46abd-544c-4931-bce2-426fe61680ff/volumes"
Jun 03 00:50:25.653530 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:25.653496    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79785956d-ncmht" event={"ID":"c795ce5b-e5d9-49f0-aeb7-ebb0d036face","Type":"ContainerStarted","Data":"0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70"}
Jun 03 00:50:25.671850 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:25.671799    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79785956d-ncmht" podStartSLOduration=1.037050989 podStartE2EDuration="3.671785141s" podCreationTimestamp="2026-06-03 00:50:22 +0000 UTC" firstStartedPulling="2026-06-03 00:50:22.793701963 +0000 UTC m=+84.120211248" lastFinishedPulling="2026-06-03 00:50:25.42843611 +0000 UTC m=+86.754945400" observedRunningTime="2026-06-03 00:50:25.670262428 +0000 UTC m=+86.996771734" watchObservedRunningTime="2026-06-03 00:50:25.671785141 +0000 UTC m=+86.998294449"
Jun 03 00:50:32.652391 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:32.652356    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:32.652862 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:32.652407    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:32.657039 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:32.657021    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:32.676004 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:32.675972    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:50:35.483755 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:35.483709    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:35.483755 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:35.483767    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:41.602293 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:41.602259    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6jg28"
Jun 03 00:50:55.489383 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:55.489347    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:50:55.493639 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:50:55.493610    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66778f6cd5-jcw8n"
Jun 03 00:51:44.373951 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.373915    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-77745bb9f8-6lqgk"]
Jun 03 00:51:44.374402 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.374235    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb46abd-544c-4931-bce2-426fe61680ff" containerName="registry"
Jun 03 00:51:44.374402 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.374251    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb46abd-544c-4931-bce2-426fe61680ff" containerName="registry"
Jun 03 00:51:44.374402 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.374296    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="cfb46abd-544c-4931-bce2-426fe61680ff" containerName="registry"
Jun 03 00:51:44.377338 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.377320    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.386728 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.386701    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77745bb9f8-6lqgk"]
Jun 03 00:51:44.471741 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.471700    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-oauth-config\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.471926 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.471755    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xg6p\" (UniqueName: \"kubernetes.io/projected/3b0fa302-2d56-4674-8a7a-1c3356550619-kube-api-access-2xg6p\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.471926 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.471808    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-service-ca\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.471926 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.471830    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-oauth-serving-cert\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.471926 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.471898    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-trusted-ca-bundle\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.472063 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.471943    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-console-config\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.472063 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.471969    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-serving-cert\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.572709 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.572627    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-oauth-config\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.572709 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.572721    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xg6p\" (UniqueName: \"kubernetes.io/projected/3b0fa302-2d56-4674-8a7a-1c3356550619-kube-api-access-2xg6p\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.572929 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.572742    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-service-ca\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.572929 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.572758    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-oauth-serving-cert\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.572929 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.572779    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-trusted-ca-bundle\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.572929 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.572812    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-console-config\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.572929 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.572842    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-serving-cert\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.573593 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.573568    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-service-ca\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.573593 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.573583    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-console-config\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.573780 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.573646    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-oauth-serving-cert\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.573846 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.573829    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-trusted-ca-bundle\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.575160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.575136    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-oauth-config\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.575412 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.575397    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-serving-cert\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.582346 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.582327    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xg6p\" (UniqueName: \"kubernetes.io/projected/3b0fa302-2d56-4674-8a7a-1c3356550619-kube-api-access-2xg6p\") pod \"console-77745bb9f8-6lqgk\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") " pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.686771 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.686681    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:44.811304 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.811279    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77745bb9f8-6lqgk"]
Jun 03 00:51:44.813751 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:51:44.813725    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0fa302_2d56_4674_8a7a_1c3356550619.slice/crio-677bebdfd6318657c648f30ebdeb9fce71c7ac2998dbec88061ea926658d0255 WatchSource:0}: Error finding container 677bebdfd6318657c648f30ebdeb9fce71c7ac2998dbec88061ea926658d0255: Status 404 returned error can't find the container with id 677bebdfd6318657c648f30ebdeb9fce71c7ac2998dbec88061ea926658d0255
Jun 03 00:51:44.860571 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:44.860541    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77745bb9f8-6lqgk" event={"ID":"3b0fa302-2d56-4674-8a7a-1c3356550619","Type":"ContainerStarted","Data":"677bebdfd6318657c648f30ebdeb9fce71c7ac2998dbec88061ea926658d0255"}
Jun 03 00:51:45.864972 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:45.864936    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77745bb9f8-6lqgk" event={"ID":"3b0fa302-2d56-4674-8a7a-1c3356550619","Type":"ContainerStarted","Data":"e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518"}
Jun 03 00:51:45.883179 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:45.883126    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-77745bb9f8-6lqgk" podStartSLOduration=1.8831066829999998 podStartE2EDuration="1.883106683s" podCreationTimestamp="2026-06-03 00:51:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:51:45.88247503 +0000 UTC m=+167.208984331" watchObservedRunningTime="2026-06-03 00:51:45.883106683 +0000 UTC m=+167.209615991"
Jun 03 00:51:54.687836 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:54.687791    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:54.687836 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:54.687846    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:54.692455 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:54.692431    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:54.893161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:54.893129    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:51:54.935357 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:51:54.935319    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79785956d-ncmht"]
Jun 03 00:52:19.954955 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:19.954888    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-79785956d-ncmht" podUID="c795ce5b-e5d9-49f0-aeb7-ebb0d036face" containerName="console" containerID="cri-o://0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70" gracePeriod=15
Jun 03 00:52:20.196823 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.196799    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79785956d-ncmht_c795ce5b-e5d9-49f0-aeb7-ebb0d036face/console/0.log"
Jun 03 00:52:20.196953 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.196861    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:52:20.369772 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.369739    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pddk\" (UniqueName: \"kubernetes.io/projected/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-kube-api-access-2pddk\") pod \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") "
Jun 03 00:52:20.369967 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.369790    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-oauth-serving-cert\") pod \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") "
Jun 03 00:52:20.369967 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.369833    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-serving-cert\") pod \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") "
Jun 03 00:52:20.369967 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.369861    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-config\") pod \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") "
Jun 03 00:52:20.369967 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.369893    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-trusted-ca-bundle\") pod \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") "
Jun 03 00:52:20.369967 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.369912    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-service-ca\") pod \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") "
Jun 03 00:52:20.369967 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.369928    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-oauth-config\") pod \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\" (UID: \"c795ce5b-e5d9-49f0-aeb7-ebb0d036face\") "
Jun 03 00:52:20.370376 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.370346    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c795ce5b-e5d9-49f0-aeb7-ebb0d036face" (UID: "c795ce5b-e5d9-49f0-aeb7-ebb0d036face"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:52:20.370376 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.370370    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-config" (OuterVolumeSpecName: "console-config") pod "c795ce5b-e5d9-49f0-aeb7-ebb0d036face" (UID: "c795ce5b-e5d9-49f0-aeb7-ebb0d036face"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:52:20.370494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.370383    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-service-ca" (OuterVolumeSpecName: "service-ca") pod "c795ce5b-e5d9-49f0-aeb7-ebb0d036face" (UID: "c795ce5b-e5d9-49f0-aeb7-ebb0d036face"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:52:20.370494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.370432    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c795ce5b-e5d9-49f0-aeb7-ebb0d036face" (UID: "c795ce5b-e5d9-49f0-aeb7-ebb0d036face"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:52:20.372242 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.372208    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c795ce5b-e5d9-49f0-aeb7-ebb0d036face" (UID: "c795ce5b-e5d9-49f0-aeb7-ebb0d036face"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:52:20.372242 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.372228    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-kube-api-access-2pddk" (OuterVolumeSpecName: "kube-api-access-2pddk") pod "c795ce5b-e5d9-49f0-aeb7-ebb0d036face" (UID: "c795ce5b-e5d9-49f0-aeb7-ebb0d036face"). InnerVolumeSpecName "kube-api-access-2pddk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:52:20.372378 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.372235    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c795ce5b-e5d9-49f0-aeb7-ebb0d036face" (UID: "c795ce5b-e5d9-49f0-aeb7-ebb0d036face"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:52:20.470841 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.470799    2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-service-ca\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:52:20.470841 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.470833    2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-oauth-config\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:52:20.470841 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.470845    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pddk\" (UniqueName: \"kubernetes.io/projected/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-kube-api-access-2pddk\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:52:20.471058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.470855    2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-oauth-serving-cert\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:52:20.471058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.470863    2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-serving-cert\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:52:20.471058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.470872    2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-console-config\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:52:20.471058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.470881    2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c795ce5b-e5d9-49f0-aeb7-ebb0d036face-trusted-ca-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:52:20.964330 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.964302    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79785956d-ncmht_c795ce5b-e5d9-49f0-aeb7-ebb0d036face/console/0.log"
Jun 03 00:52:20.964778 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.964342    2551 generic.go:358] "Generic (PLEG): container finished" podID="c795ce5b-e5d9-49f0-aeb7-ebb0d036face" containerID="0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70" exitCode=2
Jun 03 00:52:20.964778 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.964403    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79785956d-ncmht" event={"ID":"c795ce5b-e5d9-49f0-aeb7-ebb0d036face","Type":"ContainerDied","Data":"0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70"}
Jun 03 00:52:20.964778 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.964429    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79785956d-ncmht" event={"ID":"c795ce5b-e5d9-49f0-aeb7-ebb0d036face","Type":"ContainerDied","Data":"138c69a2c660e99267016457d1d7cab9e8ab0d3ab4507d36c331a715156801bf"}
Jun 03 00:52:20.964778 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.964443    2551 scope.go:117] "RemoveContainer" containerID="0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70"
Jun 03 00:52:20.964778 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.964448    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79785956d-ncmht"
Jun 03 00:52:20.973645 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.973621    2551 scope.go:117] "RemoveContainer" containerID="0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70"
Jun 03 00:52:20.973999 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:52:20.973968    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70\": container with ID starting with 0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70 not found: ID does not exist" containerID="0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70"
Jun 03 00:52:20.974073 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.974012    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70"} err="failed to get container status \"0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70\": rpc error: code = NotFound desc = could not find container \"0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70\": container with ID starting with 0ab6b9dfb65b2092c9ace2e2489e3dad5ae4d1b522b92c387fb5a23f79edbb70 not found: ID does not exist"
Jun 03 00:52:20.987842 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.987816    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79785956d-ncmht"]
Jun 03 00:52:20.992195 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:20.992174    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79785956d-ncmht"]
Jun 03 00:52:21.222682 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:21.222570    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c795ce5b-e5d9-49f0-aeb7-ebb0d036face" path="/var/lib/kubelet/pods/c795ce5b-e5d9-49f0-aeb7-ebb0d036face/volumes"
Jun 03 00:52:59.702186 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.702150    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8d7595bf-6wzz5"]
Jun 03 00:52:59.702572 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.702401    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c795ce5b-e5d9-49f0-aeb7-ebb0d036face" containerName="console"
Jun 03 00:52:59.702572 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.702413    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c795ce5b-e5d9-49f0-aeb7-ebb0d036face" containerName="console"
Jun 03 00:52:59.702572 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.702465    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="c795ce5b-e5d9-49f0-aeb7-ebb0d036face" containerName="console"
Jun 03 00:52:59.706360 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.706339    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.713956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.713934    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8d7595bf-6wzz5"]
Jun 03 00:52:59.760425 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.760386    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-oauth-config\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.760425 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.760426    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-console-config\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.760639 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.760449    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-trusted-ca-bundle\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.760639 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.760521    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-service-ca\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.760639 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.760560    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-serving-cert\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.760639 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.760576    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-oauth-serving-cert\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.760639 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.760595    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwsp\" (UniqueName: \"kubernetes.io/projected/3da55f0a-c5ab-4701-a720-c2932cda9408-kube-api-access-rqwsp\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.861965 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.861927    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-console-config\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.861965 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.861971    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-trusted-ca-bundle\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.861997    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-service-ca\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862025    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-serving-cert\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862040    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-oauth-serving-cert\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862062    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwsp\" (UniqueName: \"kubernetes.io/projected/3da55f0a-c5ab-4701-a720-c2932cda9408-kube-api-access-rqwsp\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862099    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-oauth-config\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862734 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862707    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-console-config\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862840 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862816    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-oauth-serving-cert\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862962 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862941    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-trusted-ca-bundle\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.862998 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.862953    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-service-ca\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.864428 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.864406    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-oauth-config\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.864579 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.864562    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-serving-cert\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:52:59.870554 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:52:59.870533    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwsp\" (UniqueName: \"kubernetes.io/projected/3da55f0a-c5ab-4701-a720-c2932cda9408-kube-api-access-rqwsp\") pod \"console-b8d7595bf-6wzz5\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") " pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:53:00.015847 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:00.015756    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:53:00.141817 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:00.141792    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8d7595bf-6wzz5"]
Jun 03 00:53:00.144133 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:53:00.144106    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da55f0a_c5ab_4701_a720_c2932cda9408.slice/crio-97e348cc81a2741b0d5fcdf45979c7fb5b2189f167063c090a8e399ed2664605 WatchSource:0}: Error finding container 97e348cc81a2741b0d5fcdf45979c7fb5b2189f167063c090a8e399ed2664605: Status 404 returned error can't find the container with id 97e348cc81a2741b0d5fcdf45979c7fb5b2189f167063c090a8e399ed2664605
Jun 03 00:53:01.079361 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:01.079317    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d7595bf-6wzz5" event={"ID":"3da55f0a-c5ab-4701-a720-c2932cda9408","Type":"ContainerStarted","Data":"0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1"}
Jun 03 00:53:01.079361 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:01.079363    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d7595bf-6wzz5" event={"ID":"3da55f0a-c5ab-4701-a720-c2932cda9408","Type":"ContainerStarted","Data":"97e348cc81a2741b0d5fcdf45979c7fb5b2189f167063c090a8e399ed2664605"}
Jun 03 00:53:01.098251 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:01.098187    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b8d7595bf-6wzz5" podStartSLOduration=2.098171234 podStartE2EDuration="2.098171234s" podCreationTimestamp="2026-06-03 00:52:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:53:01.096587039 +0000 UTC m=+242.423096348" watchObservedRunningTime="2026-06-03 00:53:01.098171234 +0000 UTC m=+242.424680542"
Jun 03 00:53:10.016507 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:10.016467    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:53:10.016992 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:10.016551    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:53:10.021347 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:10.021325    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:53:10.105394 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:10.105364    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:53:10.149020 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:10.148988    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77745bb9f8-6lqgk"]
Jun 03 00:53:35.170719 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.170614    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-77745bb9f8-6lqgk" podUID="3b0fa302-2d56-4674-8a7a-1c3356550619" containerName="console" containerID="cri-o://e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518" gracePeriod=15
Jun 03 00:53:35.416435 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.416412    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77745bb9f8-6lqgk_3b0fa302-2d56-4674-8a7a-1c3356550619/console/0.log"
Jun 03 00:53:35.416549 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.416471    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:53:35.549363 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549262    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-serving-cert\") pod \"3b0fa302-2d56-4674-8a7a-1c3356550619\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") "
Jun 03 00:53:35.549363 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549305    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-oauth-serving-cert\") pod \"3b0fa302-2d56-4674-8a7a-1c3356550619\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") "
Jun 03 00:53:35.549363 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549329    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-trusted-ca-bundle\") pod \"3b0fa302-2d56-4674-8a7a-1c3356550619\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") "
Jun 03 00:53:35.549363 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549348    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xg6p\" (UniqueName: \"kubernetes.io/projected/3b0fa302-2d56-4674-8a7a-1c3356550619-kube-api-access-2xg6p\") pod \"3b0fa302-2d56-4674-8a7a-1c3356550619\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") "
Jun 03 00:53:35.549363 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549363    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-console-config\") pod \"3b0fa302-2d56-4674-8a7a-1c3356550619\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") "
Jun 03 00:53:35.549776 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549399    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-service-ca\") pod \"3b0fa302-2d56-4674-8a7a-1c3356550619\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") "
Jun 03 00:53:35.549776 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549422    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-oauth-config\") pod \"3b0fa302-2d56-4674-8a7a-1c3356550619\" (UID: \"3b0fa302-2d56-4674-8a7a-1c3356550619\") "
Jun 03 00:53:35.549885 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549859    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b0fa302-2d56-4674-8a7a-1c3356550619" (UID: "3b0fa302-2d56-4674-8a7a-1c3356550619"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:53:35.549936 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549865    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b0fa302-2d56-4674-8a7a-1c3356550619" (UID: "3b0fa302-2d56-4674-8a7a-1c3356550619"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:53:35.549978 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549958    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-console-config" (OuterVolumeSpecName: "console-config") pod "3b0fa302-2d56-4674-8a7a-1c3356550619" (UID: "3b0fa302-2d56-4674-8a7a-1c3356550619"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:53:35.550014 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.549991    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b0fa302-2d56-4674-8a7a-1c3356550619" (UID: "3b0fa302-2d56-4674-8a7a-1c3356550619"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:53:35.551515 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.551491    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b0fa302-2d56-4674-8a7a-1c3356550619" (UID: "3b0fa302-2d56-4674-8a7a-1c3356550619"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:53:35.551591 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.551559    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b0fa302-2d56-4674-8a7a-1c3356550619-kube-api-access-2xg6p" (OuterVolumeSpecName: "kube-api-access-2xg6p") pod "3b0fa302-2d56-4674-8a7a-1c3356550619" (UID: "3b0fa302-2d56-4674-8a7a-1c3356550619"). InnerVolumeSpecName "kube-api-access-2xg6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:53:35.551635 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.551584    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b0fa302-2d56-4674-8a7a-1c3356550619" (UID: "3b0fa302-2d56-4674-8a7a-1c3356550619"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:53:35.650320 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.650278    2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-serving-cert\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:35.650320 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.650313    2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-oauth-serving-cert\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:35.650320 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.650322    2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-trusted-ca-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:35.650320 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.650331    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xg6p\" (UniqueName: \"kubernetes.io/projected/3b0fa302-2d56-4674-8a7a-1c3356550619-kube-api-access-2xg6p\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:35.650556 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.650341    2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-console-config\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:35.650556 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.650350    2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0fa302-2d56-4674-8a7a-1c3356550619-service-ca\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:35.650556 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:35.650358    2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0fa302-2d56-4674-8a7a-1c3356550619-console-oauth-config\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:36.171988 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.171961    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77745bb9f8-6lqgk_3b0fa302-2d56-4674-8a7a-1c3356550619/console/0.log"
Jun 03 00:53:36.172413 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.172001    2551 generic.go:358] "Generic (PLEG): container finished" podID="3b0fa302-2d56-4674-8a7a-1c3356550619" containerID="e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518" exitCode=2
Jun 03 00:53:36.172413 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.172064    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77745bb9f8-6lqgk"
Jun 03 00:53:36.172413 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.172067    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77745bb9f8-6lqgk" event={"ID":"3b0fa302-2d56-4674-8a7a-1c3356550619","Type":"ContainerDied","Data":"e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518"}
Jun 03 00:53:36.172413 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.172155    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77745bb9f8-6lqgk" event={"ID":"3b0fa302-2d56-4674-8a7a-1c3356550619","Type":"ContainerDied","Data":"677bebdfd6318657c648f30ebdeb9fce71c7ac2998dbec88061ea926658d0255"}
Jun 03 00:53:36.172413 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.172171    2551 scope.go:117] "RemoveContainer" containerID="e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518"
Jun 03 00:53:36.180495 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.180475    2551 scope.go:117] "RemoveContainer" containerID="e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518"
Jun 03 00:53:36.180774 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:53:36.180754    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518\": container with ID starting with e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518 not found: ID does not exist" containerID="e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518"
Jun 03 00:53:36.180845 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.180781    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518"} err="failed to get container status \"e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518\": rpc error: code = NotFound desc = could not find container \"e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518\": container with ID starting with e8e10109e01e2ad5bb83d89693493887cce94d786b178a0ac59376cbcb645518 not found: ID does not exist"
Jun 03 00:53:36.194818 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.194792    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77745bb9f8-6lqgk"]
Jun 03 00:53:36.198522 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:36.198495    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77745bb9f8-6lqgk"]
Jun 03 00:53:37.223671 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.223621    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b0fa302-2d56-4674-8a7a-1c3356550619" path="/var/lib/kubelet/pods/3b0fa302-2d56-4674-8a7a-1c3356550619/volumes"
Jun 03 00:53:37.910453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.910418    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"]
Jun 03 00:53:37.910718 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.910704    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b0fa302-2d56-4674-8a7a-1c3356550619" containerName="console"
Jun 03 00:53:37.910768 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.910720    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b0fa302-2d56-4674-8a7a-1c3356550619" containerName="console"
Jun 03 00:53:37.910802 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.910777    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b0fa302-2d56-4674-8a7a-1c3356550619" containerName="console"
Jun 03 00:53:37.915211 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.915194    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:37.917946 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.917927    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 00:53:37.919059 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.919042    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l24zp\""
Jun 03 00:53:37.919159 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.919090    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 00:53:37.923801 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:37.923776    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"]
Jun 03 00:53:38.069529 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.069465    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.069751 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.069568    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.069751 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.069593    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwntv\" (UniqueName: \"kubernetes.io/projected/c7599cc0-42fe-44aa-a999-98f1148fc7f6-kube-api-access-kwntv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.170540 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.170451    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.170540 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.170517    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.170540 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.170539    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwntv\" (UniqueName: \"kubernetes.io/projected/c7599cc0-42fe-44aa-a999-98f1148fc7f6-kube-api-access-kwntv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.170885 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.170862    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.170919 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.170890    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.179165 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.179140    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwntv\" (UniqueName: \"kubernetes.io/projected/c7599cc0-42fe-44aa-a999-98f1148fc7f6-kube-api-access-kwntv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.224375 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.224324    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:38.350715 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:38.350678    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"]
Jun 03 00:53:39.182932 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:39.182895    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2" event={"ID":"c7599cc0-42fe-44aa-a999-98f1148fc7f6","Type":"ContainerStarted","Data":"5223d643644bbee7320aaa4138573d17a7c134e89b9844d345908e6a8b8bf591"}
Jun 03 00:53:45.205740 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:45.205705    2551 generic.go:358] "Generic (PLEG): container finished" podID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerID="268c80ef2ca22884aef087cd26e6c5658a236fc536eebf9ddfc647ef14347890" exitCode=0
Jun 03 00:53:45.206160 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:45.205747    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2" event={"ID":"c7599cc0-42fe-44aa-a999-98f1148fc7f6","Type":"ContainerDied","Data":"268c80ef2ca22884aef087cd26e6c5658a236fc536eebf9ddfc647ef14347890"}
Jun 03 00:53:47.212911 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:47.212877    2551 generic.go:358] "Generic (PLEG): container finished" podID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerID="8a81e8f2d3317cec8ada08b8fd2e66187f1980ac52a55e95811dc57d2cba03a6" exitCode=0
Jun 03 00:53:47.213312 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:47.212951    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2" event={"ID":"c7599cc0-42fe-44aa-a999-98f1148fc7f6","Type":"ContainerDied","Data":"8a81e8f2d3317cec8ada08b8fd2e66187f1980ac52a55e95811dc57d2cba03a6"}
Jun 03 00:53:56.239542 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:56.239504    2551 generic.go:358] "Generic (PLEG): container finished" podID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerID="d62a768d7b52cbfaa923265bc274b837be5667a27e91fb0f9f891c7c57a2118c" exitCode=0
Jun 03 00:53:56.239542 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:56.239552    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2" event={"ID":"c7599cc0-42fe-44aa-a999-98f1148fc7f6","Type":"ContainerDied","Data":"d62a768d7b52cbfaa923265bc274b837be5667a27e91fb0f9f891c7c57a2118c"}
Jun 03 00:53:57.365209 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.365186    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:57.425694 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.425638    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwntv\" (UniqueName: \"kubernetes.io/projected/c7599cc0-42fe-44aa-a999-98f1148fc7f6-kube-api-access-kwntv\") pod \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") "
Jun 03 00:53:57.425894 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.425717    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-util\") pod \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") "
Jun 03 00:53:57.425894 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.425745    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-bundle\") pod \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\" (UID: \"c7599cc0-42fe-44aa-a999-98f1148fc7f6\") "
Jun 03 00:53:57.426450 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.426412    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-bundle" (OuterVolumeSpecName: "bundle") pod "c7599cc0-42fe-44aa-a999-98f1148fc7f6" (UID: "c7599cc0-42fe-44aa-a999-98f1148fc7f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:53:57.427891 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.427856    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7599cc0-42fe-44aa-a999-98f1148fc7f6-kube-api-access-kwntv" (OuterVolumeSpecName: "kube-api-access-kwntv") pod "c7599cc0-42fe-44aa-a999-98f1148fc7f6" (UID: "c7599cc0-42fe-44aa-a999-98f1148fc7f6"). InnerVolumeSpecName "kube-api-access-kwntv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:53:57.430304 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.430279    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-util" (OuterVolumeSpecName: "util") pod "c7599cc0-42fe-44aa-a999-98f1148fc7f6" (UID: "c7599cc0-42fe-44aa-a999-98f1148fc7f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:53:57.527227 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.527138    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:57.527227 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.527169    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7599cc0-42fe-44aa-a999-98f1148fc7f6-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:57.527227 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:57.527179    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwntv\" (UniqueName: \"kubernetes.io/projected/c7599cc0-42fe-44aa-a999-98f1148fc7f6-kube-api-access-kwntv\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:53:58.245877 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:58.245836    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2" event={"ID":"c7599cc0-42fe-44aa-a999-98f1148fc7f6","Type":"ContainerDied","Data":"5223d643644bbee7320aaa4138573d17a7c134e89b9844d345908e6a8b8bf591"}
Jun 03 00:53:58.245877 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:58.245881    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5223d643644bbee7320aaa4138573d17a7c134e89b9844d345908e6a8b8bf591"
Jun 03 00:53:58.246129 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:58.245851    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5c9k2"
Jun 03 00:53:59.153189 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:53:59.153164    2551 kubelet.go:1628] "Image garbage collection succeeded"
Jun 03 00:54:10.082502 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082466    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"]
Jun 03 00:54:10.084066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082771    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerName="util"
Jun 03 00:54:10.084066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082783    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerName="util"
Jun 03 00:54:10.084066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082790    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerName="extract"
Jun 03 00:54:10.084066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082795    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerName="extract"
Jun 03 00:54:10.084066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082803    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerName="pull"
Jun 03 00:54:10.084066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082808    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerName="pull"
Jun 03 00:54:10.084066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.082857    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7599cc0-42fe-44aa-a999-98f1148fc7f6" containerName="extract"
Jun 03 00:54:10.084516 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.084500    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.087185 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.087132    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l24zp\""
Jun 03 00:54:10.087359 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.087344    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 00:54:10.088323 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.088306    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 00:54:10.095910 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.095889    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"]
Jun 03 00:54:10.122067 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.122033    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.122067 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.122066    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.122256 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.122090    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krrdf\" (UniqueName: \"kubernetes.io/projected/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-kube-api-access-krrdf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.223134 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.223095    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.223134 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.223136    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.223360 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.223163    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krrdf\" (UniqueName: \"kubernetes.io/projected/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-kube-api-access-krrdf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.223484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.223464    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.223526 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.223479    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.231703 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.231679    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krrdf\" (UniqueName: \"kubernetes.io/projected/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-kube-api-access-krrdf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.393429 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.393397    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:10.512650 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.512624    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"]
Jun 03 00:54:10.514792 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:54:10.514765    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fc02be_7efa_41e8_b43c_b2d871ef06a1.slice/crio-5f52ba70a552e54bd54f018ed12da7fd0eeefcfff983dff5c4f2adbec62c3935 WatchSource:0}: Error finding container 5f52ba70a552e54bd54f018ed12da7fd0eeefcfff983dff5c4f2adbec62c3935: Status 404 returned error can't find the container with id 5f52ba70a552e54bd54f018ed12da7fd0eeefcfff983dff5c4f2adbec62c3935
Jun 03 00:54:10.516555 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:10.516541    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 00:54:11.281169 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.281133    2551 generic.go:358] "Generic (PLEG): container finished" podID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerID="9d5a207016b493317c8f28a39d4783f758c3baefdf6d2fa83e8bcc2fa099a92d" exitCode=0
Jun 03 00:54:11.281558 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.281219    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm" event={"ID":"f6fc02be-7efa-41e8-b43c-b2d871ef06a1","Type":"ContainerDied","Data":"9d5a207016b493317c8f28a39d4783f758c3baefdf6d2fa83e8bcc2fa099a92d"}
Jun 03 00:54:11.281558 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.281255    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm" event={"ID":"f6fc02be-7efa-41e8-b43c-b2d871ef06a1","Type":"ContainerStarted","Data":"5f52ba70a552e54bd54f018ed12da7fd0eeefcfff983dff5c4f2adbec62c3935"}
Jun 03 00:54:11.693582 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.693549    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xgqpz"]
Jun 03 00:54:11.695515 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.695499    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:11.698035 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.698010    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 03 00:54:11.698169 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.698052    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-65qv7\""
Jun 03 00:54:11.698169 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.698066    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 03 00:54:11.704116 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.704092    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xgqpz"]
Jun 03 00:54:11.736053 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.736021    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c4ad1d1-3f39-44ec-b804-eb665a927b13-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xgqpz\" (UID: \"2c4ad1d1-3f39-44ec-b804-eb665a927b13\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:11.736235 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.736067    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf8tw\" (UniqueName: \"kubernetes.io/projected/2c4ad1d1-3f39-44ec-b804-eb665a927b13-kube-api-access-sf8tw\") pod \"cert-manager-webhook-587ccfb98-xgqpz\" (UID: \"2c4ad1d1-3f39-44ec-b804-eb665a927b13\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:11.837264 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.837228    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sf8tw\" (UniqueName: \"kubernetes.io/projected/2c4ad1d1-3f39-44ec-b804-eb665a927b13-kube-api-access-sf8tw\") pod \"cert-manager-webhook-587ccfb98-xgqpz\" (UID: \"2c4ad1d1-3f39-44ec-b804-eb665a927b13\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:11.837438 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.837289    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c4ad1d1-3f39-44ec-b804-eb665a927b13-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xgqpz\" (UID: \"2c4ad1d1-3f39-44ec-b804-eb665a927b13\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:11.845372 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.845348    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c4ad1d1-3f39-44ec-b804-eb665a927b13-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xgqpz\" (UID: \"2c4ad1d1-3f39-44ec-b804-eb665a927b13\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:11.845635 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:11.845612    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf8tw\" (UniqueName: \"kubernetes.io/projected/2c4ad1d1-3f39-44ec-b804-eb665a927b13-kube-api-access-sf8tw\") pod \"cert-manager-webhook-587ccfb98-xgqpz\" (UID: \"2c4ad1d1-3f39-44ec-b804-eb665a927b13\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:12.019837 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:12.019728    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:12.139536 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:12.139510    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xgqpz"]
Jun 03 00:54:12.141762 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:54:12.141727    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c4ad1d1_3f39_44ec_b804_eb665a927b13.slice/crio-4204768ce2370454c165769d87e8ba3ca6b5735dc3094162e021aaa928c5f795 WatchSource:0}: Error finding container 4204768ce2370454c165769d87e8ba3ca6b5735dc3094162e021aaa928c5f795: Status 404 returned error can't find the container with id 4204768ce2370454c165769d87e8ba3ca6b5735dc3094162e021aaa928c5f795
Jun 03 00:54:12.284980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:12.284899    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz" event={"ID":"2c4ad1d1-3f39-44ec-b804-eb665a927b13","Type":"ContainerStarted","Data":"4204768ce2370454c165769d87e8ba3ca6b5735dc3094162e021aaa928c5f795"}
Jun 03 00:54:15.301329 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:15.301292    2551 generic.go:358] "Generic (PLEG): container finished" podID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerID="85cee77f1b9eccb520eb96c782c0204cf753dd7be5732fd59b1f98e9e328dffd" exitCode=0
Jun 03 00:54:15.301796 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:15.301349    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm" event={"ID":"f6fc02be-7efa-41e8-b43c-b2d871ef06a1","Type":"ContainerDied","Data":"85cee77f1b9eccb520eb96c782c0204cf753dd7be5732fd59b1f98e9e328dffd"}
Jun 03 00:54:16.305415 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:16.305378    2551 generic.go:358] "Generic (PLEG): container finished" podID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerID="4a9ffc66c8112df01ea98dbe556a9e87ba8aa812597b8e7103bcff37c4061512" exitCode=0
Jun 03 00:54:16.305905 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:16.305445    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm" event={"ID":"f6fc02be-7efa-41e8-b43c-b2d871ef06a1","Type":"ContainerDied","Data":"4a9ffc66c8112df01ea98dbe556a9e87ba8aa812597b8e7103bcff37c4061512"}
Jun 03 00:54:16.306740 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:16.306714    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz" event={"ID":"2c4ad1d1-3f39-44ec-b804-eb665a927b13","Type":"ContainerStarted","Data":"81549b259be9fab71ffd71fcd04d025234ca2224318ad0c0c98daa8c0abc440f"}
Jun 03 00:54:16.306857 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:16.306834    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:16.338914 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:16.338798    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz" podStartSLOduration=1.355505939 podStartE2EDuration="5.338781665s" podCreationTimestamp="2026-06-03 00:54:11 +0000 UTC" firstStartedPulling="2026-06-03 00:54:12.143615208 +0000 UTC m=+313.470124493" lastFinishedPulling="2026-06-03 00:54:16.126890926 +0000 UTC m=+317.453400219" observedRunningTime="2026-06-03 00:54:16.337749045 +0000 UTC m=+317.664258352" watchObservedRunningTime="2026-06-03 00:54:16.338781665 +0000 UTC m=+317.665290971"
Jun 03 00:54:17.430241 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.430217    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:17.487782 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.487753    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-bundle\") pod \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") "
Jun 03 00:54:17.487973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.487806    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krrdf\" (UniqueName: \"kubernetes.io/projected/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-kube-api-access-krrdf\") pod \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") "
Jun 03 00:54:17.487973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.487846    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-util\") pod \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\" (UID: \"f6fc02be-7efa-41e8-b43c-b2d871ef06a1\") "
Jun 03 00:54:17.488214 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.488184    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-bundle" (OuterVolumeSpecName: "bundle") pod "f6fc02be-7efa-41e8-b43c-b2d871ef06a1" (UID: "f6fc02be-7efa-41e8-b43c-b2d871ef06a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:54:17.489978 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.489953    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-kube-api-access-krrdf" (OuterVolumeSpecName: "kube-api-access-krrdf") pod "f6fc02be-7efa-41e8-b43c-b2d871ef06a1" (UID: "f6fc02be-7efa-41e8-b43c-b2d871ef06a1"). InnerVolumeSpecName "kube-api-access-krrdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:54:17.492037 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.491999    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-util" (OuterVolumeSpecName: "util") pod "f6fc02be-7efa-41e8-b43c-b2d871ef06a1" (UID: "f6fc02be-7efa-41e8-b43c-b2d871ef06a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:54:17.589367 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.589271    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:54:17.589367 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.589309    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krrdf\" (UniqueName: \"kubernetes.io/projected/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-kube-api-access-krrdf\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:54:17.589367 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:17.589323    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fc02be-7efa-41e8-b43c-b2d871ef06a1-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:54:18.313752 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:18.313726    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm"
Jun 03 00:54:18.313920 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:18.313721    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5vzm" event={"ID":"f6fc02be-7efa-41e8-b43c-b2d871ef06a1","Type":"ContainerDied","Data":"5f52ba70a552e54bd54f018ed12da7fd0eeefcfff983dff5c4f2adbec62c3935"}
Jun 03 00:54:18.313920 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:18.313830    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f52ba70a552e54bd54f018ed12da7fd0eeefcfff983dff5c4f2adbec62c3935"
Jun 03 00:54:21.932574 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932536    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-qjnkd"]
Jun 03 00:54:21.933001 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932829    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerName="util"
Jun 03 00:54:21.933001 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932840    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerName="util"
Jun 03 00:54:21.933001 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932848    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerName="pull"
Jun 03 00:54:21.933001 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932855    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerName="pull"
Jun 03 00:54:21.933001 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932875    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerName="extract"
Jun 03 00:54:21.933001 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932880    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerName="extract"
Jun 03 00:54:21.933001 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.932917    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6fc02be-7efa-41e8-b43c-b2d871ef06a1" containerName="extract"
Jun 03 00:54:21.938304 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.938286    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:21.940889 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.940863    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9h6mx\""
Jun 03 00:54:21.945965 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:21.945941    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-qjnkd"]
Jun 03 00:54:22.022445 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.022407    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b29c5a8-8cb7-470a-8dca-5d10cf008555-bound-sa-token\") pod \"cert-manager-79c8d999ff-qjnkd\" (UID: \"3b29c5a8-8cb7-470a-8dca-5d10cf008555\") " pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:22.022620 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.022456    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m99x\" (UniqueName: \"kubernetes.io/projected/3b29c5a8-8cb7-470a-8dca-5d10cf008555-kube-api-access-8m99x\") pod \"cert-manager-79c8d999ff-qjnkd\" (UID: \"3b29c5a8-8cb7-470a-8dca-5d10cf008555\") " pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:22.123875 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.123837    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b29c5a8-8cb7-470a-8dca-5d10cf008555-bound-sa-token\") pod \"cert-manager-79c8d999ff-qjnkd\" (UID: \"3b29c5a8-8cb7-470a-8dca-5d10cf008555\") " pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:22.123973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.123880    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m99x\" (UniqueName: \"kubernetes.io/projected/3b29c5a8-8cb7-470a-8dca-5d10cf008555-kube-api-access-8m99x\") pod \"cert-manager-79c8d999ff-qjnkd\" (UID: \"3b29c5a8-8cb7-470a-8dca-5d10cf008555\") " pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:22.131938 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.131906    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b29c5a8-8cb7-470a-8dca-5d10cf008555-bound-sa-token\") pod \"cert-manager-79c8d999ff-qjnkd\" (UID: \"3b29c5a8-8cb7-470a-8dca-5d10cf008555\") " pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:22.132066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.131968    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m99x\" (UniqueName: \"kubernetes.io/projected/3b29c5a8-8cb7-470a-8dca-5d10cf008555-kube-api-access-8m99x\") pod \"cert-manager-79c8d999ff-qjnkd\" (UID: \"3b29c5a8-8cb7-470a-8dca-5d10cf008555\") " pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:22.247910 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.247811    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-qjnkd"
Jun 03 00:54:22.312514 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.312487    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xgqpz"
Jun 03 00:54:22.373219 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:22.373191    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-qjnkd"]
Jun 03 00:54:22.375264 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:54:22.375232    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b29c5a8_8cb7_470a_8dca_5d10cf008555.slice/crio-f94defe2404afcb249887edb5d7ff0eb1c38dcdb89948758dd9ae16576b7462b WatchSource:0}: Error finding container f94defe2404afcb249887edb5d7ff0eb1c38dcdb89948758dd9ae16576b7462b: Status 404 returned error can't find the container with id f94defe2404afcb249887edb5d7ff0eb1c38dcdb89948758dd9ae16576b7462b
Jun 03 00:54:23.330262 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.330229    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-qjnkd" event={"ID":"3b29c5a8-8cb7-470a-8dca-5d10cf008555","Type":"ContainerStarted","Data":"a378606012d078cb78700339e89a77b2d360e416af5f8378d4c43a8d5539ccae"}
Jun 03 00:54:23.330262 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.330264    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-qjnkd" event={"ID":"3b29c5a8-8cb7-470a-8dca-5d10cf008555","Type":"ContainerStarted","Data":"f94defe2404afcb249887edb5d7ff0eb1c38dcdb89948758dd9ae16576b7462b"}
Jun 03 00:54:23.346164 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.346090    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-qjnkd" podStartSLOduration=2.346075517 podStartE2EDuration="2.346075517s" podCreationTimestamp="2026-06-03 00:54:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:54:23.345250906 +0000 UTC m=+324.671760215" watchObservedRunningTime="2026-06-03 00:54:23.346075517 +0000 UTC m=+324.672584824"
Jun 03 00:54:23.845079 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.845049    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"]
Jun 03 00:54:23.848521 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.848504    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:23.851164 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.851145    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 00:54:23.852311 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.852291    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lkzk5\""
Jun 03 00:54:23.852311 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.852299    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 00:54:23.857198 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.857176    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"]
Jun 03 00:54:23.939310 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.939273    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0586c78-ed6c-4194-8134-af5d875e56d4-tmp\") pod \"openshift-lws-operator-bfc7f696d-z57bs\" (UID: \"f0586c78-ed6c-4194-8134-af5d875e56d4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:23.939482 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:23.939333    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-972qh\" (UniqueName: \"kubernetes.io/projected/f0586c78-ed6c-4194-8134-af5d875e56d4-kube-api-access-972qh\") pod \"openshift-lws-operator-bfc7f696d-z57bs\" (UID: \"f0586c78-ed6c-4194-8134-af5d875e56d4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:24.040058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:24.040020    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-972qh\" (UniqueName: \"kubernetes.io/projected/f0586c78-ed6c-4194-8134-af5d875e56d4-kube-api-access-972qh\") pod \"openshift-lws-operator-bfc7f696d-z57bs\" (UID: \"f0586c78-ed6c-4194-8134-af5d875e56d4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:24.040266 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:24.040078    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0586c78-ed6c-4194-8134-af5d875e56d4-tmp\") pod \"openshift-lws-operator-bfc7f696d-z57bs\" (UID: \"f0586c78-ed6c-4194-8134-af5d875e56d4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:24.040398 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:24.040380    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0586c78-ed6c-4194-8134-af5d875e56d4-tmp\") pod \"openshift-lws-operator-bfc7f696d-z57bs\" (UID: \"f0586c78-ed6c-4194-8134-af5d875e56d4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:24.048490 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:24.048461    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-972qh\" (UniqueName: \"kubernetes.io/projected/f0586c78-ed6c-4194-8134-af5d875e56d4-kube-api-access-972qh\") pod \"openshift-lws-operator-bfc7f696d-z57bs\" (UID: \"f0586c78-ed6c-4194-8134-af5d875e56d4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:24.158650 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:24.158612    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"
Jun 03 00:54:24.282513 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:24.282462    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs"]
Jun 03 00:54:24.284550 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:54:24.284517    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0586c78_ed6c_4194_8134_af5d875e56d4.slice/crio-8d0e6f75ab6ea4766099c44f80cd0fdb447733216fb44fa44187b0ee9fadae05 WatchSource:0}: Error finding container 8d0e6f75ab6ea4766099c44f80cd0fdb447733216fb44fa44187b0ee9fadae05: Status 404 returned error can't find the container with id 8d0e6f75ab6ea4766099c44f80cd0fdb447733216fb44fa44187b0ee9fadae05
Jun 03 00:54:24.334075 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:24.334040    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs" event={"ID":"f0586c78-ed6c-4194-8134-af5d875e56d4","Type":"ContainerStarted","Data":"8d0e6f75ab6ea4766099c44f80cd0fdb447733216fb44fa44187b0ee9fadae05"}
Jun 03 00:54:26.340846 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:26.340759    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs" event={"ID":"f0586c78-ed6c-4194-8134-af5d875e56d4","Type":"ContainerStarted","Data":"a1a869d5e6798004ff82632104b9316bc9d55f81597309a9a98fe522a003c3ff"}
Jun 03 00:54:26.357337 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:26.357282    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z57bs" podStartSLOduration=1.620806252 podStartE2EDuration="3.357269779s" podCreationTimestamp="2026-06-03 00:54:23 +0000 UTC" firstStartedPulling="2026-06-03 00:54:24.286086224 +0000 UTC m=+325.612595513" lastFinishedPulling="2026-06-03 00:54:26.022549744 +0000 UTC m=+327.349059040" observedRunningTime="2026-06-03 00:54:26.355152597 +0000 UTC m=+327.681661903" watchObservedRunningTime="2026-06-03 00:54:26.357269779 +0000 UTC m=+327.683779086"
Jun 03 00:54:29.008257 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.008211    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"]
Jun 03 00:54:29.059443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.059411    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"]
Jun 03 00:54:29.059616 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.059535    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.062353 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.062328    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 00:54:29.063473 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.063435    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l24zp\""
Jun 03 00:54:29.063473 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.063452    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 00:54:29.187093 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.187051    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.187093 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.187093    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88hwv\" (UniqueName: \"kubernetes.io/projected/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-kube-api-access-88hwv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.187314 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.187120    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.288166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.288058    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.288166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.288108    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88hwv\" (UniqueName: \"kubernetes.io/projected/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-kube-api-access-88hwv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.288403 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.288167    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.288511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.288489    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.288568 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.288523    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.296555 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.296525    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88hwv\" (UniqueName: \"kubernetes.io/projected/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-kube-api-access-88hwv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.368514 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.368477    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:29.496617 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:29.496594    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"]
Jun 03 00:54:29.498608 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:54:29.498580    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10ac2b7_46ee_4ed6_9f25_d09e97cecec2.slice/crio-c6e0bd0d11898be0602b8dbb13f291aa74287b59dbeef32cd296b43ae73e76e7 WatchSource:0}: Error finding container c6e0bd0d11898be0602b8dbb13f291aa74287b59dbeef32cd296b43ae73e76e7: Status 404 returned error can't find the container with id c6e0bd0d11898be0602b8dbb13f291aa74287b59dbeef32cd296b43ae73e76e7
Jun 03 00:54:30.357955 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:30.357919    2551 generic.go:358] "Generic (PLEG): container finished" podID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerID="fd2782f4d0bb031539a394457189a34984d786d5c3f3f1048112c8910e59c77e" exitCode=0
Jun 03 00:54:30.358337 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:30.357985    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9" event={"ID":"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2","Type":"ContainerDied","Data":"fd2782f4d0bb031539a394457189a34984d786d5c3f3f1048112c8910e59c77e"}
Jun 03 00:54:30.358337 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:30.358007    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9" event={"ID":"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2","Type":"ContainerStarted","Data":"c6e0bd0d11898be0602b8dbb13f291aa74287b59dbeef32cd296b43ae73e76e7"}
Jun 03 00:54:32.365578 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:32.365538    2551 generic.go:358] "Generic (PLEG): container finished" podID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerID="734d094e0f882c02fb472999ce94de6d7a615a028a23d17d0a38d687e76515ef" exitCode=0
Jun 03 00:54:32.366060 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:32.365617    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9" event={"ID":"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2","Type":"ContainerDied","Data":"734d094e0f882c02fb472999ce94de6d7a615a028a23d17d0a38d687e76515ef"}
Jun 03 00:54:33.370844 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:33.370810    2551 generic.go:358] "Generic (PLEG): container finished" podID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerID="1a9f4cf78b87c1d4fc39a3e2e209acf729e244d2aacd50eaf3988c8c8e2a66b5" exitCode=0
Jun 03 00:54:33.371233 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:33.370888    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9" event={"ID":"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2","Type":"ContainerDied","Data":"1a9f4cf78b87c1d4fc39a3e2e209acf729e244d2aacd50eaf3988c8c8e2a66b5"}
Jun 03 00:54:34.522536 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.522509    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:34.635965 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.635857    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88hwv\" (UniqueName: \"kubernetes.io/projected/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-kube-api-access-88hwv\") pod \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") "
Jun 03 00:54:34.635965 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.635919    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-bundle\") pod \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") "
Jun 03 00:54:34.636161 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.636003    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-util\") pod \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\" (UID: \"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2\") "
Jun 03 00:54:34.636737 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.636705    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-bundle" (OuterVolumeSpecName: "bundle") pod "f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" (UID: "f10ac2b7-46ee-4ed6-9f25-d09e97cecec2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:54:34.638076 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.638048    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-kube-api-access-88hwv" (OuterVolumeSpecName: "kube-api-access-88hwv") pod "f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" (UID: "f10ac2b7-46ee-4ed6-9f25-d09e97cecec2"). InnerVolumeSpecName "kube-api-access-88hwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:54:34.641514 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.641487    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-util" (OuterVolumeSpecName: "util") pod "f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" (UID: "f10ac2b7-46ee-4ed6-9f25-d09e97cecec2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:54:34.737080 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.737042    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88hwv\" (UniqueName: \"kubernetes.io/projected/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-kube-api-access-88hwv\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:54:34.737080 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.737072    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:54:34.737080 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:34.737083    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f10ac2b7-46ee-4ed6-9f25-d09e97cecec2-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:54:35.379642 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:35.379600    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9" event={"ID":"f10ac2b7-46ee-4ed6-9f25-d09e97cecec2","Type":"ContainerDied","Data":"c6e0bd0d11898be0602b8dbb13f291aa74287b59dbeef32cd296b43ae73e76e7"}
Jun 03 00:54:35.379642 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:35.379631    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2hfl9"
Jun 03 00:54:35.379642 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:35.379642    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6e0bd0d11898be0602b8dbb13f291aa74287b59dbeef32cd296b43ae73e76e7"
Jun 03 00:54:46.490561 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490469    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"]
Jun 03 00:54:46.490973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490779    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerName="extract"
Jun 03 00:54:46.490973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490796    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerName="extract"
Jun 03 00:54:46.490973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490817    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerName="pull"
Jun 03 00:54:46.490973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490825    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerName="pull"
Jun 03 00:54:46.490973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490841    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerName="util"
Jun 03 00:54:46.490973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490849    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerName="util"
Jun 03 00:54:46.490973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.490940    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="f10ac2b7-46ee-4ed6-9f25-d09e97cecec2" containerName="extract"
Jun 03 00:54:46.493962 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.493946    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.496686 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.496649    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 00:54:46.496854 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.496716    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 00:54:46.496958 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.496945    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 00:54:46.497020 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.496977    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-whgm8\""
Jun 03 00:54:46.497020 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.497003    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 00:54:46.505446 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.505422    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"]
Jun 03 00:54:46.637286 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.637236    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e40d3e-8f23-4e0e-9031-8282627acea1-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.637462 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.637297    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c8e40d3e-8f23-4e0e-9031-8282627acea1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.637462 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.637395    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8e40d3e-8f23-4e0e-9031-8282627acea1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.637462 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.637443    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c8e40d3e-8f23-4e0e-9031-8282627acea1-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.637618 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.637511    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdksb\" (UniqueName: \"kubernetes.io/projected/c8e40d3e-8f23-4e0e-9031-8282627acea1-kube-api-access-hdksb\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.738182 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.738144    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdksb\" (UniqueName: \"kubernetes.io/projected/c8e40d3e-8f23-4e0e-9031-8282627acea1-kube-api-access-hdksb\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.738182 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.738193    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e40d3e-8f23-4e0e-9031-8282627acea1-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.738441 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.738330    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c8e40d3e-8f23-4e0e-9031-8282627acea1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.738441 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.738393    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8e40d3e-8f23-4e0e-9031-8282627acea1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.738441 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.738429    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c8e40d3e-8f23-4e0e-9031-8282627acea1-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.738829 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.738803    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c8e40d3e-8f23-4e0e-9031-8282627acea1-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.740409 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.740382    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e40d3e-8f23-4e0e-9031-8282627acea1-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.740688 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.740625    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c8e40d3e-8f23-4e0e-9031-8282627acea1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.740688 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.740639    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8e40d3e-8f23-4e0e-9031-8282627acea1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.747270 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.747250    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdksb\" (UniqueName: \"kubernetes.io/projected/c8e40d3e-8f23-4e0e-9031-8282627acea1-kube-api-access-hdksb\") pod \"opendatahub-operator-controller-manager-7c859dd94f-4gjqq\" (UID: \"c8e40d3e-8f23-4e0e-9031-8282627acea1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.804750 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.804709    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:46.939972 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:46.939945    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"]
Jun 03 00:54:46.944654 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:54:46.944621    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e40d3e_8f23_4e0e_9031_8282627acea1.slice/crio-d7414c6d788ae7063cda073c92b894e2a67cbd692db7a37b503e8bc788655bd9 WatchSource:0}: Error finding container d7414c6d788ae7063cda073c92b894e2a67cbd692db7a37b503e8bc788655bd9: Status 404 returned error can't find the container with id d7414c6d788ae7063cda073c92b894e2a67cbd692db7a37b503e8bc788655bd9
Jun 03 00:54:47.418769 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:47.418733    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq" event={"ID":"c8e40d3e-8f23-4e0e-9031-8282627acea1","Type":"ContainerStarted","Data":"d7414c6d788ae7063cda073c92b894e2a67cbd692db7a37b503e8bc788655bd9"}
Jun 03 00:54:50.431066 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:50.431025    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq" event={"ID":"c8e40d3e-8f23-4e0e-9031-8282627acea1","Type":"ContainerStarted","Data":"e532ad975017eab59c2a1b940a84378fa594befe59e09ad47fc2879dc0a88eb7"}
Jun 03 00:54:51.435361 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:51.435325    2551 generic.go:358] "Generic (PLEG): container finished" podID="c8e40d3e-8f23-4e0e-9031-8282627acea1" containerID="e532ad975017eab59c2a1b940a84378fa594befe59e09ad47fc2879dc0a88eb7" exitCode=0
Jun 03 00:54:51.435760 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:51.435366    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq" event={"ID":"c8e40d3e-8f23-4e0e-9031-8282627acea1","Type":"ContainerDied","Data":"e532ad975017eab59c2a1b940a84378fa594befe59e09ad47fc2879dc0a88eb7"}
Jun 03 00:54:52.440136 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:52.440089    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq" event={"ID":"c8e40d3e-8f23-4e0e-9031-8282627acea1","Type":"ContainerStarted","Data":"e6efe752dd80339fbacf8e14ddc6f50e7b6b5d058b90501cf459347d7afc2b0b"}
Jun 03 00:54:52.440573 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:52.440236    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:54:52.463642 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:54:52.463585    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq" podStartSLOduration=1.53374915 podStartE2EDuration="6.463570201s" podCreationTimestamp="2026-06-03 00:54:46 +0000 UTC" firstStartedPulling="2026-06-03 00:54:46.946203368 +0000 UTC m=+348.272712653" lastFinishedPulling="2026-06-03 00:54:51.876024416 +0000 UTC m=+353.202533704" observedRunningTime="2026-06-03 00:54:52.462471053 +0000 UTC m=+353.788980360" watchObservedRunningTime="2026-06-03 00:54:52.463570201 +0000 UTC m=+353.790079508"
Jun 03 00:55:03.446456 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:03.446418    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-4gjqq"
Jun 03 00:55:05.703996 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.703959    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-m9lk9"]
Jun 03 00:55:05.712496 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.712469    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:05.715123 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.715093    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-m9lk9"]
Jun 03 00:55:05.715255 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.715127    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 03 00:55:05.715255 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.715183    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-flzng\""
Jun 03 00:55:05.785027 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.784989    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8scc9\" (UniqueName: \"kubernetes.io/projected/607b7446-0990-498a-b516-ac98c5d44853-kube-api-access-8scc9\") pod \"odh-model-controller-76588b95-m9lk9\" (UID: \"607b7446-0990-498a-b516-ac98c5d44853\") " pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:05.785203 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.785110    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/607b7446-0990-498a-b516-ac98c5d44853-cert\") pod \"odh-model-controller-76588b95-m9lk9\" (UID: \"607b7446-0990-498a-b516-ac98c5d44853\") " pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:05.886167 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.886119    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/607b7446-0990-498a-b516-ac98c5d44853-cert\") pod \"odh-model-controller-76588b95-m9lk9\" (UID: \"607b7446-0990-498a-b516-ac98c5d44853\") " pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:05.886340 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.886187    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8scc9\" (UniqueName: \"kubernetes.io/projected/607b7446-0990-498a-b516-ac98c5d44853-kube-api-access-8scc9\") pod \"odh-model-controller-76588b95-m9lk9\" (UID: \"607b7446-0990-498a-b516-ac98c5d44853\") " pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:05.886340 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:55:05.886287    2551 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 03 00:55:05.886416 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:55:05.886383    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/607b7446-0990-498a-b516-ac98c5d44853-cert podName:607b7446-0990-498a-b516-ac98c5d44853 nodeName:}" failed. No retries permitted until 2026-06-03 00:55:06.386366424 +0000 UTC m=+367.712875708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/607b7446-0990-498a-b516-ac98c5d44853-cert") pod "odh-model-controller-76588b95-m9lk9" (UID: "607b7446-0990-498a-b516-ac98c5d44853") : secret "odh-model-controller-webhook-cert" not found
Jun 03 00:55:05.894878 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:05.894847    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8scc9\" (UniqueName: \"kubernetes.io/projected/607b7446-0990-498a-b516-ac98c5d44853-kube-api-access-8scc9\") pod \"odh-model-controller-76588b95-m9lk9\" (UID: \"607b7446-0990-498a-b516-ac98c5d44853\") " pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:06.338675 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.338624    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-ndlwf"]
Jun 03 00:55:06.341989 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.341968    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:06.344676 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.344643    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 03 00:55:06.344774 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.344697    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gm659\""
Jun 03 00:55:06.352011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.351985    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-ndlwf"]
Jun 03 00:55:06.391009 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.390976    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba674455-9e54-4f9c-90ce-8a742ed59979-tls-certs\") pod \"model-serving-api-6577596cd5-ndlwf\" (UID: \"ba674455-9e54-4f9c-90ce-8a742ed59979\") " pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:06.391173 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.391022    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/607b7446-0990-498a-b516-ac98c5d44853-cert\") pod \"odh-model-controller-76588b95-m9lk9\" (UID: \"607b7446-0990-498a-b516-ac98c5d44853\") " pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:06.391173 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.391119    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgsqm\" (UniqueName: \"kubernetes.io/projected/ba674455-9e54-4f9c-90ce-8a742ed59979-kube-api-access-bgsqm\") pod \"model-serving-api-6577596cd5-ndlwf\" (UID: \"ba674455-9e54-4f9c-90ce-8a742ed59979\") " pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:06.393447 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.393421    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/607b7446-0990-498a-b516-ac98c5d44853-cert\") pod \"odh-model-controller-76588b95-m9lk9\" (UID: \"607b7446-0990-498a-b516-ac98c5d44853\") " pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:06.492539 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.492500    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgsqm\" (UniqueName: \"kubernetes.io/projected/ba674455-9e54-4f9c-90ce-8a742ed59979-kube-api-access-bgsqm\") pod \"model-serving-api-6577596cd5-ndlwf\" (UID: \"ba674455-9e54-4f9c-90ce-8a742ed59979\") " pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:06.492739 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.492560    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba674455-9e54-4f9c-90ce-8a742ed59979-tls-certs\") pod \"model-serving-api-6577596cd5-ndlwf\" (UID: \"ba674455-9e54-4f9c-90ce-8a742ed59979\") " pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:06.492739 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:55:06.492723    2551 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 03 00:55:06.492822 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:55:06.492786    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba674455-9e54-4f9c-90ce-8a742ed59979-tls-certs podName:ba674455-9e54-4f9c-90ce-8a742ed59979 nodeName:}" failed. No retries permitted until 2026-06-03 00:55:06.992769674 +0000 UTC m=+368.319278960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ba674455-9e54-4f9c-90ce-8a742ed59979-tls-certs") pod "model-serving-api-6577596cd5-ndlwf" (UID: "ba674455-9e54-4f9c-90ce-8a742ed59979") : secret "model-serving-api-tls" not found
Jun 03 00:55:06.501861 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.501828    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgsqm\" (UniqueName: \"kubernetes.io/projected/ba674455-9e54-4f9c-90ce-8a742ed59979-kube-api-access-bgsqm\") pod \"model-serving-api-6577596cd5-ndlwf\" (UID: \"ba674455-9e54-4f9c-90ce-8a742ed59979\") " pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:06.623981 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.623931    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:06.752042 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.752017    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-m9lk9"]
Jun 03 00:55:06.754737 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:06.754710    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607b7446_0990_498a_b516_ac98c5d44853.slice/crio-6ab162ec296a7b5671d8ddbf9096ccda11b802f437d333bc88362475ee73f5e0 WatchSource:0}: Error finding container 6ab162ec296a7b5671d8ddbf9096ccda11b802f437d333bc88362475ee73f5e0: Status 404 returned error can't find the container with id 6ab162ec296a7b5671d8ddbf9096ccda11b802f437d333bc88362475ee73f5e0
Jun 03 00:55:06.996737 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.996633    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba674455-9e54-4f9c-90ce-8a742ed59979-tls-certs\") pod \"model-serving-api-6577596cd5-ndlwf\" (UID: \"ba674455-9e54-4f9c-90ce-8a742ed59979\") " pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:06.999087 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:06.999056    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba674455-9e54-4f9c-90ce-8a742ed59979-tls-certs\") pod \"model-serving-api-6577596cd5-ndlwf\" (UID: \"ba674455-9e54-4f9c-90ce-8a742ed59979\") " pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:07.251809 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:07.251699    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:07.402456 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:07.402405    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-ndlwf"]
Jun 03 00:55:07.405911 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:07.405869    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba674455_9e54_4f9c_90ce_8a742ed59979.slice/crio-4a8ad87fef2cf2143095b42e13009f0ee8956e3467c17e3e120e2f0ab3ec1966 WatchSource:0}: Error finding container 4a8ad87fef2cf2143095b42e13009f0ee8956e3467c17e3e120e2f0ab3ec1966: Status 404 returned error can't find the container with id 4a8ad87fef2cf2143095b42e13009f0ee8956e3467c17e3e120e2f0ab3ec1966
Jun 03 00:55:07.489633 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:07.489597    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-ndlwf" event={"ID":"ba674455-9e54-4f9c-90ce-8a742ed59979","Type":"ContainerStarted","Data":"4a8ad87fef2cf2143095b42e13009f0ee8956e3467c17e3e120e2f0ab3ec1966"}
Jun 03 00:55:07.490510 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:07.490487    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-m9lk9" event={"ID":"607b7446-0990-498a-b516-ac98c5d44853","Type":"ContainerStarted","Data":"6ab162ec296a7b5671d8ddbf9096ccda11b802f437d333bc88362475ee73f5e0"}
Jun 03 00:55:11.506733 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:11.506690    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-m9lk9" event={"ID":"607b7446-0990-498a-b516-ac98c5d44853","Type":"ContainerStarted","Data":"fd905dcaf55eb570c2148597761f86e93ef07b14e9ef2f70595d60b7d535dd3c"}
Jun 03 00:55:11.507155 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:11.506744    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:11.507846 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:11.507823    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-ndlwf" event={"ID":"ba674455-9e54-4f9c-90ce-8a742ed59979","Type":"ContainerStarted","Data":"4406642db195fbc3d6aff80a284fe3aab043f5f1f6c0aafef30f418f9713b976"}
Jun 03 00:55:11.507997 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:11.507981    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:11.526054 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:11.526009    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-m9lk9" podStartSLOduration=2.608527346 podStartE2EDuration="6.525994951s" podCreationTimestamp="2026-06-03 00:55:05 +0000 UTC" firstStartedPulling="2026-06-03 00:55:06.755908991 +0000 UTC m=+368.082418277" lastFinishedPulling="2026-06-03 00:55:10.673376597 +0000 UTC m=+371.999885882" observedRunningTime="2026-06-03 00:55:11.524040655 +0000 UTC m=+372.850549962" watchObservedRunningTime="2026-06-03 00:55:11.525994951 +0000 UTC m=+372.852504258"
Jun 03 00:55:11.541347 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:11.541298    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-ndlwf" podStartSLOduration=2.236705902 podStartE2EDuration="5.54128435s" podCreationTimestamp="2026-06-03 00:55:06 +0000 UTC" firstStartedPulling="2026-06-03 00:55:07.408642853 +0000 UTC m=+368.735152139" lastFinishedPulling="2026-06-03 00:55:10.713221288 +0000 UTC m=+372.039730587" observedRunningTime="2026-06-03 00:55:11.540597126 +0000 UTC m=+372.867106433" watchObservedRunningTime="2026-06-03 00:55:11.54128435 +0000 UTC m=+372.867793637"
Jun 03 00:55:14.814215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.814181    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"]
Jun 03 00:55:14.817468 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.817451    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:14.820292 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.820271    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 03 00:55:14.820370 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.820339    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nxwm6\""
Jun 03 00:55:14.832145 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.832118    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"]
Jun 03 00:55:14.835602 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.835575    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"]
Jun 03 00:55:14.839025 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.839005    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:14.841850 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.841833    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 03 00:55:14.841963 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.841854    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mvc7t\""
Jun 03 00:55:14.850351 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.850326    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"]
Jun 03 00:55:14.867508 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.867476    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-cert\") pod \"kserve-controller-manager-7c99ffcdcd-72xnr\" (UID: \"5b59a125-3691-40ba-b5dd-b4f0571a4cd4\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:14.867702 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.867538    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm6gh\" (UniqueName: \"kubernetes.io/projected/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-kube-api-access-hm6gh\") pod \"kserve-controller-manager-7c99ffcdcd-72xnr\" (UID: \"5b59a125-3691-40ba-b5dd-b4f0571a4cd4\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:14.969039 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.968995    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm6gh\" (UniqueName: \"kubernetes.io/projected/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-kube-api-access-hm6gh\") pod \"kserve-controller-manager-7c99ffcdcd-72xnr\" (UID: \"5b59a125-3691-40ba-b5dd-b4f0571a4cd4\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:14.969039 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.969044    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ad89a31-5309-4e93-8faf-ab270d050138-cert\") pod \"llmisvc-controller-manager-c6b9847d7-mqmvs\" (UID: \"6ad89a31-5309-4e93-8faf-ab270d050138\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:14.969251 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.969087    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-cert\") pod \"kserve-controller-manager-7c99ffcdcd-72xnr\" (UID: \"5b59a125-3691-40ba-b5dd-b4f0571a4cd4\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:14.969251 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.969128    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27nb\" (UniqueName: \"kubernetes.io/projected/6ad89a31-5309-4e93-8faf-ab270d050138-kube-api-access-v27nb\") pod \"llmisvc-controller-manager-c6b9847d7-mqmvs\" (UID: \"6ad89a31-5309-4e93-8faf-ab270d050138\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:14.969251 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:55:14.969223    2551 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jun 03 00:55:14.969352 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:55:14.969283    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-cert podName:5b59a125-3691-40ba-b5dd-b4f0571a4cd4 nodeName:}" failed. No retries permitted until 2026-06-03 00:55:15.469266991 +0000 UTC m=+376.795776281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-cert") pod "kserve-controller-manager-7c99ffcdcd-72xnr" (UID: "5b59a125-3691-40ba-b5dd-b4f0571a4cd4") : secret "kserve-webhook-server-cert" not found
Jun 03 00:55:14.980611 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:14.980575    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm6gh\" (UniqueName: \"kubernetes.io/projected/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-kube-api-access-hm6gh\") pod \"kserve-controller-manager-7c99ffcdcd-72xnr\" (UID: \"5b59a125-3691-40ba-b5dd-b4f0571a4cd4\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:15.070025 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.069922    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v27nb\" (UniqueName: \"kubernetes.io/projected/6ad89a31-5309-4e93-8faf-ab270d050138-kube-api-access-v27nb\") pod \"llmisvc-controller-manager-c6b9847d7-mqmvs\" (UID: \"6ad89a31-5309-4e93-8faf-ab270d050138\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:15.070025 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.069976    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ad89a31-5309-4e93-8faf-ab270d050138-cert\") pod \"llmisvc-controller-manager-c6b9847d7-mqmvs\" (UID: \"6ad89a31-5309-4e93-8faf-ab270d050138\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:15.072430 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.072399    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ad89a31-5309-4e93-8faf-ab270d050138-cert\") pod \"llmisvc-controller-manager-c6b9847d7-mqmvs\" (UID: \"6ad89a31-5309-4e93-8faf-ab270d050138\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:15.087747 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.087716    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27nb\" (UniqueName: \"kubernetes.io/projected/6ad89a31-5309-4e93-8faf-ab270d050138-kube-api-access-v27nb\") pod \"llmisvc-controller-manager-c6b9847d7-mqmvs\" (UID: \"6ad89a31-5309-4e93-8faf-ab270d050138\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:15.149818 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.149777    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:15.280823 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.280789    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"]
Jun 03 00:55:15.282483 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:15.282453    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6ad89a31_5309_4e93_8faf_ab270d050138.slice/crio-7bbd4ec5628ca6e2ae492d6b5dc10867c1497f193f21b6eadd5cdd55a3fbc316 WatchSource:0}: Error finding container 7bbd4ec5628ca6e2ae492d6b5dc10867c1497f193f21b6eadd5cdd55a3fbc316: Status 404 returned error can't find the container with id 7bbd4ec5628ca6e2ae492d6b5dc10867c1497f193f21b6eadd5cdd55a3fbc316
Jun 03 00:55:15.473508 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.473474    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-cert\") pod \"kserve-controller-manager-7c99ffcdcd-72xnr\" (UID: \"5b59a125-3691-40ba-b5dd-b4f0571a4cd4\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:15.475891 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.475870    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b59a125-3691-40ba-b5dd-b4f0571a4cd4-cert\") pod \"kserve-controller-manager-7c99ffcdcd-72xnr\" (UID: \"5b59a125-3691-40ba-b5dd-b4f0571a4cd4\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:15.522963 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.522927    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs" event={"ID":"6ad89a31-5309-4e93-8faf-ab270d050138","Type":"ContainerStarted","Data":"7bbd4ec5628ca6e2ae492d6b5dc10867c1497f193f21b6eadd5cdd55a3fbc316"}
Jun 03 00:55:15.727102 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.727008    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:15.868543 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:15.868518    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"]
Jun 03 00:55:15.886048 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:15.886010    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b59a125_3691_40ba_b5dd_b4f0571a4cd4.slice/crio-9796c1b2c3d86a0d8dd40194df6a0873e16301b66df9f63c65979e51f6c9513d WatchSource:0}: Error finding container 9796c1b2c3d86a0d8dd40194df6a0873e16301b66df9f63c65979e51f6c9513d: Status 404 returned error can't find the container with id 9796c1b2c3d86a0d8dd40194df6a0873e16301b66df9f63c65979e51f6c9513d
Jun 03 00:55:16.005459 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.005351    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"]
Jun 03 00:55:16.008590 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.008562    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.013546 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.013521    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 00:55:16.013702 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.013566    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 00:55:16.013953 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.013931    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 00:55:16.014053 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.013962    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 00:55:16.014390 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.014374    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vr84s\""
Jun 03 00:55:16.029017 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.028947    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"]
Jun 03 00:55:16.078630 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.078594    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789fac25-8285-4e18-ab72-2d7358668621-tls-certs\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.078630 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.078634    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/789fac25-8285-4e18-ab72-2d7358668621-tmp\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.078916 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.078748    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4ht5\" (UniqueName: \"kubernetes.io/projected/789fac25-8285-4e18-ab72-2d7358668621-kube-api-access-q4ht5\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.179461 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.179426    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789fac25-8285-4e18-ab72-2d7358668621-tls-certs\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.179461 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.179465    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/789fac25-8285-4e18-ab72-2d7358668621-tmp\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.179685 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.179583    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4ht5\" (UniqueName: \"kubernetes.io/projected/789fac25-8285-4e18-ab72-2d7358668621-kube-api-access-q4ht5\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.181802 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.181778    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/789fac25-8285-4e18-ab72-2d7358668621-tmp\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.182054 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.182027    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789fac25-8285-4e18-ab72-2d7358668621-tls-certs\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.189887 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.189857    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4ht5\" (UniqueName: \"kubernetes.io/projected/789fac25-8285-4e18-ab72-2d7358668621-kube-api-access-q4ht5\") pod \"kube-auth-proxy-df58ddb79-rm99k\" (UID: \"789fac25-8285-4e18-ab72-2d7358668621\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.319440 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.319360    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"
Jun 03 00:55:16.528860 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.528821    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr" event={"ID":"5b59a125-3691-40ba-b5dd-b4f0571a4cd4","Type":"ContainerStarted","Data":"9796c1b2c3d86a0d8dd40194df6a0873e16301b66df9f63c65979e51f6c9513d"}
Jun 03 00:55:16.723756 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:16.723726    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-df58ddb79-rm99k"]
Jun 03 00:55:16.724440 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:16.724410    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789fac25_8285_4e18_ab72_2d7358668621.slice/crio-fea189e45eb49303dcd0074cde12db26c33df81116027993aa873b5634ec2b72 WatchSource:0}: Error finding container fea189e45eb49303dcd0074cde12db26c33df81116027993aa873b5634ec2b72: Status 404 returned error can't find the container with id fea189e45eb49303dcd0074cde12db26c33df81116027993aa873b5634ec2b72
Jun 03 00:55:17.533564 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.533529    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k" event={"ID":"789fac25-8285-4e18-ab72-2d7358668621","Type":"ContainerStarted","Data":"fea189e45eb49303dcd0074cde12db26c33df81116027993aa873b5634ec2b72"}
Jun 03 00:55:17.704578 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.704540    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"]
Jun 03 00:55:17.708071 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.708048    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.711272 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.711245    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 00:55:17.711408 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.711318    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l24zp\""
Jun 03 00:55:17.712478 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.712451    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 00:55:17.720506 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.720479    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"]
Jun 03 00:55:17.793980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.793876    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.793980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.793959    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.794217 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.793990    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dzxd\" (UniqueName: \"kubernetes.io/projected/4bad0251-f145-48d5-a10f-35b864ca03fe-kube-api-access-4dzxd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.894956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.894916    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.894956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.894973    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.895192 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.895062    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dzxd\" (UniqueName: \"kubernetes.io/projected/4bad0251-f145-48d5-a10f-35b864ca03fe-kube-api-access-4dzxd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.895292 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.895278    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.895340 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.895322    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:17.905736 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:17.905704    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dzxd\" (UniqueName: \"kubernetes.io/projected/4bad0251-f145-48d5-a10f-35b864ca03fe-kube-api-access-4dzxd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:18.020867 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:18.020824    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:20.183023 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.183000    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"]
Jun 03 00:55:20.184416 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:20.184390    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bad0251_f145_48d5_a10f_35b864ca03fe.slice/crio-3895fb0976731a8d2bcb397ee632e28d94390b03dbbeb08a109355d0915c309e WatchSource:0}: Error finding container 3895fb0976731a8d2bcb397ee632e28d94390b03dbbeb08a109355d0915c309e: Status 404 returned error can't find the container with id 3895fb0976731a8d2bcb397ee632e28d94390b03dbbeb08a109355d0915c309e
Jun 03 00:55:20.547520 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.547427    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs" event={"ID":"6ad89a31-5309-4e93-8faf-ab270d050138","Type":"ContainerStarted","Data":"8da467d9b77bf5ef869596d9bd624bb7e2fbd098a80b7e037f56bb72d39a6d13"}
Jun 03 00:55:20.547520 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.547503    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:20.548759 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.548734    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr" event={"ID":"5b59a125-3691-40ba-b5dd-b4f0571a4cd4","Type":"ContainerStarted","Data":"a07db5d94b8425d8ca838d4e7d24a151acf35b9d72a5d1c52f99f9c7b38d6324"}
Jun 03 00:55:20.548897 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.548876    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:20.550187 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.550161    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k" event={"ID":"789fac25-8285-4e18-ab72-2d7358668621","Type":"ContainerStarted","Data":"2da485a1166dc1cd4c7765240a8a64511b6625a0bfc02d0e90340a37d61278d3"}
Jun 03 00:55:20.551553 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.551532    2551 generic.go:358] "Generic (PLEG): container finished" podID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerID="17ac2e9ce05b067c0ca987aea5b199597d8a42a3aa98b04d5510373eb46e2518" exitCode=0
Jun 03 00:55:20.551648 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.551580    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn" event={"ID":"4bad0251-f145-48d5-a10f-35b864ca03fe","Type":"ContainerDied","Data":"17ac2e9ce05b067c0ca987aea5b199597d8a42a3aa98b04d5510373eb46e2518"}
Jun 03 00:55:20.551648 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.551607    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn" event={"ID":"4bad0251-f145-48d5-a10f-35b864ca03fe","Type":"ContainerStarted","Data":"3895fb0976731a8d2bcb397ee632e28d94390b03dbbeb08a109355d0915c309e"}
Jun 03 00:55:20.564380 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.564330    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs" podStartSLOduration=1.796476029 podStartE2EDuration="6.564316755s" podCreationTimestamp="2026-06-03 00:55:14 +0000 UTC" firstStartedPulling="2026-06-03 00:55:15.283912091 +0000 UTC m=+376.610421379" lastFinishedPulling="2026-06-03 00:55:20.051752799 +0000 UTC m=+381.378262105" observedRunningTime="2026-06-03 00:55:20.562582473 +0000 UTC m=+381.889091781" watchObservedRunningTime="2026-06-03 00:55:20.564316755 +0000 UTC m=+381.890826061"
Jun 03 00:55:20.594010 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.593960    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-df58ddb79-rm99k" podStartSLOduration=2.262543578 podStartE2EDuration="5.593945164s" podCreationTimestamp="2026-06-03 00:55:15 +0000 UTC" firstStartedPulling="2026-06-03 00:55:16.726137494 +0000 UTC m=+378.052646779" lastFinishedPulling="2026-06-03 00:55:20.057539071 +0000 UTC m=+381.384048365" observedRunningTime="2026-06-03 00:55:20.591882074 +0000 UTC m=+381.918391375" watchObservedRunningTime="2026-06-03 00:55:20.593945164 +0000 UTC m=+381.920454495"
Jun 03 00:55:20.607972 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:20.607907    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr" podStartSLOduration=2.443726385 podStartE2EDuration="6.607892516s" podCreationTimestamp="2026-06-03 00:55:14 +0000 UTC" firstStartedPulling="2026-06-03 00:55:15.887287956 +0000 UTC m=+377.213797241" lastFinishedPulling="2026-06-03 00:55:20.051454073 +0000 UTC m=+381.377963372" observedRunningTime="2026-06-03 00:55:20.606767982 +0000 UTC m=+381.933277290" watchObservedRunningTime="2026-06-03 00:55:20.607892516 +0000 UTC m=+381.934401823"
Jun 03 00:55:21.556892 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:21.556794    2551 generic.go:358] "Generic (PLEG): container finished" podID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerID="1776136ceb3ed83a0d37aee52023206484188ee9214a6e666a36958d5a3f6a2c" exitCode=0
Jun 03 00:55:21.557283 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:21.556885    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn" event={"ID":"4bad0251-f145-48d5-a10f-35b864ca03fe","Type":"ContainerDied","Data":"1776136ceb3ed83a0d37aee52023206484188ee9214a6e666a36958d5a3f6a2c"}
Jun 03 00:55:22.513494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:22.513458    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-m9lk9"
Jun 03 00:55:22.515486 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:22.515461    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-ndlwf"
Jun 03 00:55:22.563007 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:22.562965    2551 generic.go:358] "Generic (PLEG): container finished" podID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerID="eb38124de065458a07b9b1a6a986a4ca0fe4c285eca52b6a1155642e150c44fd" exitCode=0
Jun 03 00:55:22.563395 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:22.563050    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn" event={"ID":"4bad0251-f145-48d5-a10f-35b864ca03fe","Type":"ContainerDied","Data":"eb38124de065458a07b9b1a6a986a4ca0fe4c285eca52b6a1155642e150c44fd"}
Jun 03 00:55:23.716137 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.716110    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:23.849910 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.849874    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dzxd\" (UniqueName: \"kubernetes.io/projected/4bad0251-f145-48d5-a10f-35b864ca03fe-kube-api-access-4dzxd\") pod \"4bad0251-f145-48d5-a10f-35b864ca03fe\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") "
Jun 03 00:55:23.850077 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.849925    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-bundle\") pod \"4bad0251-f145-48d5-a10f-35b864ca03fe\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") "
Jun 03 00:55:23.850077 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.849991    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-util\") pod \"4bad0251-f145-48d5-a10f-35b864ca03fe\" (UID: \"4bad0251-f145-48d5-a10f-35b864ca03fe\") "
Jun 03 00:55:23.850873 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.850840    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-bundle" (OuterVolumeSpecName: "bundle") pod "4bad0251-f145-48d5-a10f-35b864ca03fe" (UID: "4bad0251-f145-48d5-a10f-35b864ca03fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:55:23.852011 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.851986    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bad0251-f145-48d5-a10f-35b864ca03fe-kube-api-access-4dzxd" (OuterVolumeSpecName: "kube-api-access-4dzxd") pod "4bad0251-f145-48d5-a10f-35b864ca03fe" (UID: "4bad0251-f145-48d5-a10f-35b864ca03fe"). InnerVolumeSpecName "kube-api-access-4dzxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:55:23.854809 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.854772    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-util" (OuterVolumeSpecName: "util") pod "4bad0251-f145-48d5-a10f-35b864ca03fe" (UID: "4bad0251-f145-48d5-a10f-35b864ca03fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:55:23.951058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.951017    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dzxd\" (UniqueName: \"kubernetes.io/projected/4bad0251-f145-48d5-a10f-35b864ca03fe-kube-api-access-4dzxd\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:55:23.951058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.951052    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:55:23.951058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:23.951062    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bad0251-f145-48d5-a10f-35b864ca03fe-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:55:24.571716 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:24.571675    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn" event={"ID":"4bad0251-f145-48d5-a10f-35b864ca03fe","Type":"ContainerDied","Data":"3895fb0976731a8d2bcb397ee632e28d94390b03dbbeb08a109355d0915c309e"}
Jun 03 00:55:24.571716 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:24.571711    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3895fb0976731a8d2bcb397ee632e28d94390b03dbbeb08a109355d0915c309e"
Jun 03 00:55:24.571966 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:24.571738    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mtpwn"
Jun 03 00:55:38.502215 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502176    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"]
Jun 03 00:55:38.502583 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502491    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerName="extract"
Jun 03 00:55:38.502583 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502503    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerName="extract"
Jun 03 00:55:38.502583 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502513    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerName="util"
Jun 03 00:55:38.502583 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502518    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerName="util"
Jun 03 00:55:38.502583 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502524    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerName="pull"
Jun 03 00:55:38.502583 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502530    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerName="pull"
Jun 03 00:55:38.502781 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.502596    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bad0251-f145-48d5-a10f-35b864ca03fe" containerName="extract"
Jun 03 00:55:38.506955 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.506937    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.509706 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.509680    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 00:55:38.509873 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.509857    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l24zp\""
Jun 03 00:55:38.509970 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.509952    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 00:55:38.515484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.515456    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"]
Jun 03 00:55:38.679200 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.679161    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.679200 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.679199    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.679415 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.679230    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kntb\" (UniqueName: \"kubernetes.io/projected/b75f963c-885c-4624-a8c8-f64decd6d723-kube-api-access-2kntb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.780153 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.780060    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.780153 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.780093    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.780153 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.780131    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kntb\" (UniqueName: \"kubernetes.io/projected/b75f963c-885c-4624-a8c8-f64decd6d723-kube-api-access-2kntb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.780491 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.780468    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.780564 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.780520    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.788442 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.788416    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kntb\" (UniqueName: \"kubernetes.io/projected/b75f963c-885c-4624-a8c8-f64decd6d723-kube-api-access-2kntb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.816876 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.816843    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:38.950766 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:38.950739    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"]
Jun 03 00:55:38.952443 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:38.952407    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75f963c_885c_4624_a8c8_f64decd6d723.slice/crio-ee0081602cae7feae5525a18fc81abe39f05405a14df39969d1b6f83131c9fff WatchSource:0}: Error finding container ee0081602cae7feae5525a18fc81abe39f05405a14df39969d1b6f83131c9fff: Status 404 returned error can't find the container with id ee0081602cae7feae5525a18fc81abe39f05405a14df39969d1b6f83131c9fff
Jun 03 00:55:39.621536 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:39.621497    2551 generic.go:358] "Generic (PLEG): container finished" podID="b75f963c-885c-4624-a8c8-f64decd6d723" containerID="2075fa052468f5674577d8ddb1a5ff8366b32f3a8e812181960944467b1ee468" exitCode=0
Jun 03 00:55:39.621931 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:39.621583    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq" event={"ID":"b75f963c-885c-4624-a8c8-f64decd6d723","Type":"ContainerDied","Data":"2075fa052468f5674577d8ddb1a5ff8366b32f3a8e812181960944467b1ee468"}
Jun 03 00:55:39.621931 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:39.621615    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq" event={"ID":"b75f963c-885c-4624-a8c8-f64decd6d723","Type":"ContainerStarted","Data":"ee0081602cae7feae5525a18fc81abe39f05405a14df39969d1b6f83131c9fff"}
Jun 03 00:55:40.423949 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.423918    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"]
Jun 03 00:55:40.427239 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.427222    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.430129 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.430107    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 03 00:55:40.430236 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.430212    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-br968\""
Jun 03 00:55:40.430307 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.430292    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 03 00:55:40.438023 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.437996    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"]
Jun 03 00:55:40.597276 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.597250    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/be44dcfd-7215-4b84-8a3a-185146b08414-operator-config\") pod \"servicemesh-operator3-55f49c5f94-n56tf\" (UID: \"be44dcfd-7215-4b84-8a3a-185146b08414\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.597452 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.597318    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf4cn\" (UniqueName: \"kubernetes.io/projected/be44dcfd-7215-4b84-8a3a-185146b08414-kube-api-access-sf4cn\") pod \"servicemesh-operator3-55f49c5f94-n56tf\" (UID: \"be44dcfd-7215-4b84-8a3a-185146b08414\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.626183 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.626146    2551 generic.go:358] "Generic (PLEG): container finished" podID="b75f963c-885c-4624-a8c8-f64decd6d723" containerID="906edbe6e5986f330d833e24b75b11f0a0f9a1ad1176c7445bf759dbc4a52e40" exitCode=0
Jun 03 00:55:40.626548 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.626239    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq" event={"ID":"b75f963c-885c-4624-a8c8-f64decd6d723","Type":"ContainerDied","Data":"906edbe6e5986f330d833e24b75b11f0a0f9a1ad1176c7445bf759dbc4a52e40"}
Jun 03 00:55:40.698415 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.698380    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sf4cn\" (UniqueName: \"kubernetes.io/projected/be44dcfd-7215-4b84-8a3a-185146b08414-kube-api-access-sf4cn\") pod \"servicemesh-operator3-55f49c5f94-n56tf\" (UID: \"be44dcfd-7215-4b84-8a3a-185146b08414\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.698586 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.698451    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/be44dcfd-7215-4b84-8a3a-185146b08414-operator-config\") pod \"servicemesh-operator3-55f49c5f94-n56tf\" (UID: \"be44dcfd-7215-4b84-8a3a-185146b08414\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.700992 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.700971    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/be44dcfd-7215-4b84-8a3a-185146b08414-operator-config\") pod \"servicemesh-operator3-55f49c5f94-n56tf\" (UID: \"be44dcfd-7215-4b84-8a3a-185146b08414\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.710314 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.710284    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf4cn\" (UniqueName: \"kubernetes.io/projected/be44dcfd-7215-4b84-8a3a-185146b08414-kube-api-access-sf4cn\") pod \"servicemesh-operator3-55f49c5f94-n56tf\" (UID: \"be44dcfd-7215-4b84-8a3a-185146b08414\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.737177 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.737137    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:40.885869 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:40.885840    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"]
Jun 03 00:55:40.892719 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:40.892685    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe44dcfd_7215_4b84_8a3a_185146b08414.slice/crio-b9a1b90d91216b9b7efd0a815f475399e69fb23b309a46297f7f665671b6de60 WatchSource:0}: Error finding container b9a1b90d91216b9b7efd0a815f475399e69fb23b309a46297f7f665671b6de60: Status 404 returned error can't find the container with id b9a1b90d91216b9b7efd0a815f475399e69fb23b309a46297f7f665671b6de60
Jun 03 00:55:41.631021 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:41.630985    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf" event={"ID":"be44dcfd-7215-4b84-8a3a-185146b08414","Type":"ContainerStarted","Data":"b9a1b90d91216b9b7efd0a815f475399e69fb23b309a46297f7f665671b6de60"}
Jun 03 00:55:41.632977 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:41.632952    2551 generic.go:358] "Generic (PLEG): container finished" podID="b75f963c-885c-4624-a8c8-f64decd6d723" containerID="b5cc9b5751cd4a87aed07c4eb21e6987e28a94b40df007d1b5ebd5550328b25a" exitCode=0
Jun 03 00:55:41.633097 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:41.633003    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq" event={"ID":"b75f963c-885c-4624-a8c8-f64decd6d723","Type":"ContainerDied","Data":"b5cc9b5751cd4a87aed07c4eb21e6987e28a94b40df007d1b5ebd5550328b25a"}
Jun 03 00:55:43.571299 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.571273    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:43.624515 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.624479    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-bundle\") pod \"b75f963c-885c-4624-a8c8-f64decd6d723\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") "
Jun 03 00:55:43.624734 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.624565    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-util\") pod \"b75f963c-885c-4624-a8c8-f64decd6d723\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") "
Jun 03 00:55:43.624734 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.624631    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kntb\" (UniqueName: \"kubernetes.io/projected/b75f963c-885c-4624-a8c8-f64decd6d723-kube-api-access-2kntb\") pod \"b75f963c-885c-4624-a8c8-f64decd6d723\" (UID: \"b75f963c-885c-4624-a8c8-f64decd6d723\") "
Jun 03 00:55:43.625464 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.625436    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-bundle" (OuterVolumeSpecName: "bundle") pod "b75f963c-885c-4624-a8c8-f64decd6d723" (UID: "b75f963c-885c-4624-a8c8-f64decd6d723"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:55:43.626551 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.626527    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75f963c-885c-4624-a8c8-f64decd6d723-kube-api-access-2kntb" (OuterVolumeSpecName: "kube-api-access-2kntb") pod "b75f963c-885c-4624-a8c8-f64decd6d723" (UID: "b75f963c-885c-4624-a8c8-f64decd6d723"). InnerVolumeSpecName "kube-api-access-2kntb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:55:43.630003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.629975    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-util" (OuterVolumeSpecName: "util") pod "b75f963c-885c-4624-a8c8-f64decd6d723" (UID: "b75f963c-885c-4624-a8c8-f64decd6d723"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:55:43.642913 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.642893    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq"
Jun 03 00:55:43.642913 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.642897    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqhtvq" event={"ID":"b75f963c-885c-4624-a8c8-f64decd6d723","Type":"ContainerDied","Data":"ee0081602cae7feae5525a18fc81abe39f05405a14df39969d1b6f83131c9fff"}
Jun 03 00:55:43.643030 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.642927    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee0081602cae7feae5525a18fc81abe39f05405a14df39969d1b6f83131c9fff"
Jun 03 00:55:43.725780 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.725737    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:55:43.725780 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.725779    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kntb\" (UniqueName: \"kubernetes.io/projected/b75f963c-885c-4624-a8c8-f64decd6d723-kube-api-access-2kntb\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:55:43.725969 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:43.725797    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b75f963c-885c-4624-a8c8-f64decd6d723-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:55:44.647905 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:44.647867    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf" event={"ID":"be44dcfd-7215-4b84-8a3a-185146b08414","Type":"ContainerStarted","Data":"0a1c8e549fd2076d0421056ad5e30797d0295c870d3c51508924fb80c72071d0"}
Jun 03 00:55:44.648359 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:44.647993    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:44.671541 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:44.671489    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf" podStartSLOduration=1.967978017 podStartE2EDuration="4.671477239s" podCreationTimestamp="2026-06-03 00:55:40 +0000 UTC" firstStartedPulling="2026-06-03 00:55:40.89526484 +0000 UTC m=+402.221774125" lastFinishedPulling="2026-06-03 00:55:43.598764058 +0000 UTC m=+404.925273347" observedRunningTime="2026-06-03 00:55:44.670593074 +0000 UTC m=+405.997102381" watchObservedRunningTime="2026-06-03 00:55:44.671477239 +0000 UTC m=+405.997986547"
Jun 03 00:55:49.410394 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410360    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"]
Jun 03 00:55:49.410888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410698    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75f963c-885c-4624-a8c8-f64decd6d723" containerName="util"
Jun 03 00:55:49.410888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410710    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75f963c-885c-4624-a8c8-f64decd6d723" containerName="util"
Jun 03 00:55:49.410888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410720    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75f963c-885c-4624-a8c8-f64decd6d723" containerName="pull"
Jun 03 00:55:49.410888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410726    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75f963c-885c-4624-a8c8-f64decd6d723" containerName="pull"
Jun 03 00:55:49.410888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410735    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75f963c-885c-4624-a8c8-f64decd6d723" containerName="extract"
Jun 03 00:55:49.410888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410742    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75f963c-885c-4624-a8c8-f64decd6d723" containerName="extract"
Jun 03 00:55:49.410888 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.410799    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="b75f963c-885c-4624-a8c8-f64decd6d723" containerName="extract"
Jun 03 00:55:49.453676 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.453638    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"]
Jun 03 00:55:49.453877 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.453823    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.456538 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.456513    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 00:55:49.456695 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.456520    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 03 00:55:49.456782 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.456527    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 03 00:55:49.456782 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.456531    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 03 00:55:49.456899 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.456544    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vrkfp\""
Jun 03 00:55:49.475826 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.475795    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-cacerts\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.475956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.475837    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.475956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.475863    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5v4\" (UniqueName: \"kubernetes.io/projected/90e1349b-d9bf-4fd2-8e0f-56cee0233906-kube-api-access-xv5v4\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.475956 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.475916    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.476068 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.475961    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.476068 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.475983    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-token\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.476068 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.475999    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90e1349b-d9bf-4fd2-8e0f-56cee0233906-local-certs\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.577130 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.577081    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5v4\" (UniqueName: \"kubernetes.io/projected/90e1349b-d9bf-4fd2-8e0f-56cee0233906-kube-api-access-xv5v4\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.577310 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.577159    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.577310 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.577215    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.577310 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.577248    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-token\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.577310 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.577277    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90e1349b-d9bf-4fd2-8e0f-56cee0233906-local-certs\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.577478 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.577335    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-cacerts\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.577478 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.577378    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.578117 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.578090    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.580083 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.580060    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90e1349b-d9bf-4fd2-8e0f-56cee0233906-local-certs\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.580194 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.580139    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.580282 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.580253    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-cacerts\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.580329 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.580299    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.586022 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.585998    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90e1349b-d9bf-4fd2-8e0f-56cee0233906-istio-token\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.586102 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.586047    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5v4\" (UniqueName: \"kubernetes.io/projected/90e1349b-d9bf-4fd2-8e0f-56cee0233906-kube-api-access-xv5v4\") pod \"istiod-openshift-gateway-798958bb55-49j6k\" (UID: \"90e1349b-d9bf-4fd2-8e0f-56cee0233906\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.764340 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.764255    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:49.904806 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:49.904655    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"]
Jun 03 00:55:49.907241 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:49.907209    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e1349b_d9bf_4fd2_8e0f_56cee0233906.slice/crio-a3594f95d258cb840fc837e22072064d7339fbc814f12067168d4572f09a40c7 WatchSource:0}: Error finding container a3594f95d258cb840fc837e22072064d7339fbc814f12067168d4572f09a40c7: Status 404 returned error can't find the container with id a3594f95d258cb840fc837e22072064d7339fbc814f12067168d4572f09a40c7
Jun 03 00:55:50.671218 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:50.671183    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k" event={"ID":"90e1349b-d9bf-4fd2-8e0f-56cee0233906","Type":"ContainerStarted","Data":"a3594f95d258cb840fc837e22072064d7339fbc814f12067168d4572f09a40c7"}
Jun 03 00:55:51.559366 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:51.559333    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mqmvs"
Jun 03 00:55:51.562743 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:51.562714    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnr"
Jun 03 00:55:52.577438 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:52.577388    2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jun 03 00:55:52.577739 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:52.577465    2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jun 03 00:55:52.681246 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:52.681214    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k" event={"ID":"90e1349b-d9bf-4fd2-8e0f-56cee0233906","Type":"ContainerStarted","Data":"de9c911601aebf2d84a70de4a1049e412fc94a500d175d320acdf03026641682"}
Jun 03 00:55:52.681419 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:52.681368    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:52.707300 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:52.707245    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k" podStartSLOduration=1.03977376 podStartE2EDuration="3.707228091s" podCreationTimestamp="2026-06-03 00:55:49 +0000 UTC" firstStartedPulling="2026-06-03 00:55:49.909697392 +0000 UTC m=+411.236206680" lastFinishedPulling="2026-06-03 00:55:52.577151709 +0000 UTC m=+413.903661011" observedRunningTime="2026-06-03 00:55:52.705103503 +0000 UTC m=+414.031612810" watchObservedRunningTime="2026-06-03 00:55:52.707228091 +0000 UTC m=+414.033737399"
Jun 03 00:55:53.688065 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:53.688034    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-49j6k"
Jun 03 00:55:54.034346 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.034263    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6995685bb-4s57p"]
Jun 03 00:55:54.037924 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.037897    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.040511 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.040491    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 00:55:54.040615 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.040489    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vm7g2\""
Jun 03 00:55:54.047138 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.047111    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6995685bb-4s57p"]
Jun 03 00:55:54.124146 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.124099    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pw9w\" (UniqueName: \"kubernetes.io/projected/03f03f3b-a482-4fb9-9012-4e70a14fb953-kube-api-access-4pw9w\") pod \"dashboard-redirect-6995685bb-4s57p\" (UID: \"03f03f3b-a482-4fb9-9012-4e70a14fb953\") " pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.124329 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.124162    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/03f03f3b-a482-4fb9-9012-4e70a14fb953-redirect-config\") pod \"dashboard-redirect-6995685bb-4s57p\" (UID: \"03f03f3b-a482-4fb9-9012-4e70a14fb953\") " pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.225559 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.225522    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pw9w\" (UniqueName: \"kubernetes.io/projected/03f03f3b-a482-4fb9-9012-4e70a14fb953-kube-api-access-4pw9w\") pod \"dashboard-redirect-6995685bb-4s57p\" (UID: \"03f03f3b-a482-4fb9-9012-4e70a14fb953\") " pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.225759 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.225575    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/03f03f3b-a482-4fb9-9012-4e70a14fb953-redirect-config\") pod \"dashboard-redirect-6995685bb-4s57p\" (UID: \"03f03f3b-a482-4fb9-9012-4e70a14fb953\") " pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.226284 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.226264    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/03f03f3b-a482-4fb9-9012-4e70a14fb953-redirect-config\") pod \"dashboard-redirect-6995685bb-4s57p\" (UID: \"03f03f3b-a482-4fb9-9012-4e70a14fb953\") " pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.234772 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.234748    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pw9w\" (UniqueName: \"kubernetes.io/projected/03f03f3b-a482-4fb9-9012-4e70a14fb953-kube-api-access-4pw9w\") pod \"dashboard-redirect-6995685bb-4s57p\" (UID: \"03f03f3b-a482-4fb9-9012-4e70a14fb953\") " pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.349499 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.349463    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6995685bb-4s57p"
Jun 03 00:55:54.483436 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.483397    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6995685bb-4s57p"]
Jun 03 00:55:54.485988 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:55:54.485956    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f03f3b_a482_4fb9_9012_4e70a14fb953.slice/crio-e8f78c542d1ee7a1049992bb68a283489b15613226738ce1b9bcb171f8b9184d WatchSource:0}: Error finding container e8f78c542d1ee7a1049992bb68a283489b15613226738ce1b9bcb171f8b9184d: Status 404 returned error can't find the container with id e8f78c542d1ee7a1049992bb68a283489b15613226738ce1b9bcb171f8b9184d
Jun 03 00:55:54.692010 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:54.691913    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6995685bb-4s57p" event={"ID":"03f03f3b-a482-4fb9-9012-4e70a14fb953","Type":"ContainerStarted","Data":"e8f78c542d1ee7a1049992bb68a283489b15613226738ce1b9bcb171f8b9184d"}
Jun 03 00:55:55.654185 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:55.654156    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-n56tf"
Jun 03 00:55:56.708132 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:56.708087    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6995685bb-4s57p" event={"ID":"03f03f3b-a482-4fb9-9012-4e70a14fb953","Type":"ContainerStarted","Data":"289136efe521da81210725a1926c99e7c8c8c1391e5fcd15559b691d29ae4ea3"}
Jun 03 00:55:56.762332 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:55:56.762283    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6995685bb-4s57p" podStartSLOduration=0.698557784 podStartE2EDuration="2.762269151s" podCreationTimestamp="2026-06-03 00:55:54 +0000 UTC" firstStartedPulling="2026-06-03 00:55:54.487329799 +0000 UTC m=+415.813839084" lastFinishedPulling="2026-06-03 00:55:56.551041153 +0000 UTC m=+417.877550451" observedRunningTime="2026-06-03 00:55:56.758819507 +0000 UTC m=+418.085328814" watchObservedRunningTime="2026-06-03 00:55:56.762269151 +0000 UTC m=+418.088778457"
Jun 03 00:56:22.565016 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.564937    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"]
Jun 03 00:56:22.577741 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.577711    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"]
Jun 03 00:56:22.577885 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.577826    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.580728 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.580688    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 00:56:22.580728 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.580697    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 00:56:22.580921 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.580789    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2d4wz\""
Jun 03 00:56:22.678030 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.677987    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.678030 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.678030    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.678236 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.678049    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rxp\" (UniqueName: \"kubernetes.io/projected/290ca5c7-b781-4570-83c0-82ce525d5722-kube-api-access-w5rxp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.779470 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.779431    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.779470 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.779473    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.779655 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.779493    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rxp\" (UniqueName: \"kubernetes.io/projected/290ca5c7-b781-4570-83c0-82ce525d5722-kube-api-access-w5rxp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.779932 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.779910    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.779932 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.779924    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.788533 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.788505    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rxp\" (UniqueName: \"kubernetes.io/projected/290ca5c7-b781-4570-83c0-82ce525d5722-kube-api-access-w5rxp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:22.887954 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:22.887921    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:23.004528 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.004499    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"]
Jun 03 00:56:23.013075 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.013047    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.016504 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.016477    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"]
Jun 03 00:56:23.027221 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.027195    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"]
Jun 03 00:56:23.030171 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:56:23.030145    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290ca5c7_b781_4570_83c0_82ce525d5722.slice/crio-eb1e67a1a7e2c0f08640f23f807d5615eb518c79bd3e5c295fc3f694708ee939 WatchSource:0}: Error finding container eb1e67a1a7e2c0f08640f23f807d5615eb518c79bd3e5c295fc3f694708ee939: Status 404 returned error can't find the container with id eb1e67a1a7e2c0f08640f23f807d5615eb518c79bd3e5c295fc3f694708ee939
Jun 03 00:56:23.182192 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.182156    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.182192 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.182201    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.182424 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.182315    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmq6f\" (UniqueName: \"kubernetes.io/projected/1df20887-830d-4ef4-846c-7e0ace5e2c37-kube-api-access-nmq6f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.283313 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.283277    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.283494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.283330    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.283494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.283409    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmq6f\" (UniqueName: \"kubernetes.io/projected/1df20887-830d-4ef4-846c-7e0ace5e2c37-kube-api-access-nmq6f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.283776 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.283751    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.283776 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.283770    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.292893 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.292867    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmq6f\" (UniqueName: \"kubernetes.io/projected/1df20887-830d-4ef4-846c-7e0ace5e2c37-kube-api-access-nmq6f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.323785 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.323753    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:23.370133 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.370079    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"]
Jun 03 00:56:23.375600 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.375572    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.382338 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.382253    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"]
Jun 03 00:56:23.460372 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.460339    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"]
Jun 03 00:56:23.461563 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:56:23.461540    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df20887_830d_4ef4_846c_7e0ace5e2c37.slice/crio-2abc73c93140730e0142e245712f9ffb47d6c3784c69a4ac464b28e9c67719b4 WatchSource:0}: Error finding container 2abc73c93140730e0142e245712f9ffb47d6c3784c69a4ac464b28e9c67719b4: Status 404 returned error can't find the container with id 2abc73c93140730e0142e245712f9ffb47d6c3784c69a4ac464b28e9c67719b4
Jun 03 00:56:23.484860 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.484831    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.484980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.484878    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf9m6\" (UniqueName: \"kubernetes.io/projected/a023d55f-50b3-46ab-9d6d-7d041c71df61-kube-api-access-sf9m6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.484980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.484909    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.568854 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.568828    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"]
Jun 03 00:56:23.572202 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.572184    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.579485 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.579459    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"]
Jun 03 00:56:23.586273 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.586250    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.586371 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.586286    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sf9m6\" (UniqueName: \"kubernetes.io/projected/a023d55f-50b3-46ab-9d6d-7d041c71df61-kube-api-access-sf9m6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.586371 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.586315    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.586705 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.586684    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.586705 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.586698    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.594531 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.594503    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf9m6\" (UniqueName: \"kubernetes.io/projected/a023d55f-50b3-46ab-9d6d-7d041c71df61-kube-api-access-sf9m6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.687256 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.687162    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.687408 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.687277    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.687408 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.687309    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcn5s\" (UniqueName: \"kubernetes.io/projected/74b31ea8-6264-4e04-92b2-673def33497c-kube-api-access-kcn5s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.688512 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.688500    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:23.788430 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.788379    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.788604 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.788476    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.788604 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.788515    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcn5s\" (UniqueName: \"kubernetes.io/projected/74b31ea8-6264-4e04-92b2-673def33497c-kube-api-access-kcn5s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.788880 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.788855    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.789148 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.789119    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.797615 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.797582    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcn5s\" (UniqueName: \"kubernetes.io/projected/74b31ea8-6264-4e04-92b2-673def33497c-kube-api-access-kcn5s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:23.803786 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.803750    2551 generic.go:358] "Generic (PLEG): container finished" podID="290ca5c7-b781-4570-83c0-82ce525d5722" containerID="2495970c423fb5202e8662b6fc40191a5a3239d95bfe79a64f51466c5eacff08" exitCode=0
Jun 03 00:56:23.803939 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.803903    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t" event={"ID":"290ca5c7-b781-4570-83c0-82ce525d5722","Type":"ContainerDied","Data":"2495970c423fb5202e8662b6fc40191a5a3239d95bfe79a64f51466c5eacff08"}
Jun 03 00:56:23.804098 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.804067    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t" event={"ID":"290ca5c7-b781-4570-83c0-82ce525d5722","Type":"ContainerStarted","Data":"eb1e67a1a7e2c0f08640f23f807d5615eb518c79bd3e5c295fc3f694708ee939"}
Jun 03 00:56:23.805801 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.805769    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw" event={"ID":"1df20887-830d-4ef4-846c-7e0ace5e2c37","Type":"ContainerDied","Data":"fc4720103df323fc0511321149257e95e9a04edbf08d8f71f121f5f9801944b3"}
Jun 03 00:56:23.805801 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.805769    2551 generic.go:358] "Generic (PLEG): container finished" podID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerID="fc4720103df323fc0511321149257e95e9a04edbf08d8f71f121f5f9801944b3" exitCode=0
Jun 03 00:56:23.805972 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.805853    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw" event={"ID":"1df20887-830d-4ef4-846c-7e0ace5e2c37","Type":"ContainerStarted","Data":"2abc73c93140730e0142e245712f9ffb47d6c3784c69a4ac464b28e9c67719b4"}
Jun 03 00:56:23.819235 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.819209    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"]
Jun 03 00:56:23.821654 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:56:23.821627    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda023d55f_50b3_46ab_9d6d_7d041c71df61.slice/crio-be537c79c8410fd2199e78d81a041010d83ce4fdd2f29031b7f3d723a4a67701 WatchSource:0}: Error finding container be537c79c8410fd2199e78d81a041010d83ce4fdd2f29031b7f3d723a4a67701: Status 404 returned error can't find the container with id be537c79c8410fd2199e78d81a041010d83ce4fdd2f29031b7f3d723a4a67701
Jun 03 00:56:23.916596 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:23.916558    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:24.050326 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.050142    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"]
Jun 03 00:56:24.051761 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:56:24.051708    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b31ea8_6264_4e04_92b2_673def33497c.slice/crio-539d80838de58a251c789cbd4282d4ef3ddaee974f9865b69c79e2c72a165c07 WatchSource:0}: Error finding container 539d80838de58a251c789cbd4282d4ef3ddaee974f9865b69c79e2c72a165c07: Status 404 returned error can't find the container with id 539d80838de58a251c789cbd4282d4ef3ddaee974f9865b69c79e2c72a165c07
Jun 03 00:56:24.810703 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.810653    2551 generic.go:358] "Generic (PLEG): container finished" podID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerID="e11314475efbc9abed9fa6ab41edef6dda1fe79c53e0e1ecdf7c83cb2fdb503d" exitCode=0
Jun 03 00:56:24.811099 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.810700    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw" event={"ID":"1df20887-830d-4ef4-846c-7e0ace5e2c37","Type":"ContainerDied","Data":"e11314475efbc9abed9fa6ab41edef6dda1fe79c53e0e1ecdf7c83cb2fdb503d"}
Jun 03 00:56:24.812446 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.812300    2551 generic.go:358] "Generic (PLEG): container finished" podID="290ca5c7-b781-4570-83c0-82ce525d5722" containerID="021115e62bf338a652be2e2e63b093139d1f9dae5105ee7a20c99ebecb0a226f" exitCode=0
Jun 03 00:56:24.812446 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.812333    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t" event={"ID":"290ca5c7-b781-4570-83c0-82ce525d5722","Type":"ContainerDied","Data":"021115e62bf338a652be2e2e63b093139d1f9dae5105ee7a20c99ebecb0a226f"}
Jun 03 00:56:24.813876 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.813852    2551 generic.go:358] "Generic (PLEG): container finished" podID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerID="ecca7c761df4226cdccbe474db0abcb4e6112e6b9762cc6fc4a51fc3882db3c7" exitCode=0
Jun 03 00:56:24.813968 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.813937    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49" event={"ID":"a023d55f-50b3-46ab-9d6d-7d041c71df61","Type":"ContainerDied","Data":"ecca7c761df4226cdccbe474db0abcb4e6112e6b9762cc6fc4a51fc3882db3c7"}
Jun 03 00:56:24.814025 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.813967    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49" event={"ID":"a023d55f-50b3-46ab-9d6d-7d041c71df61","Type":"ContainerStarted","Data":"be537c79c8410fd2199e78d81a041010d83ce4fdd2f29031b7f3d723a4a67701"}
Jun 03 00:56:24.815522 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.815502    2551 generic.go:358] "Generic (PLEG): container finished" podID="74b31ea8-6264-4e04-92b2-673def33497c" containerID="bb8b2d0a6ae4bc187dbf76ff7868ef5e0760579913beb315df8ea26285db6020" exitCode=0
Jun 03 00:56:24.815789 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.815551    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7" event={"ID":"74b31ea8-6264-4e04-92b2-673def33497c","Type":"ContainerDied","Data":"bb8b2d0a6ae4bc187dbf76ff7868ef5e0760579913beb315df8ea26285db6020"}
Jun 03 00:56:24.815789 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:24.815574    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7" event={"ID":"74b31ea8-6264-4e04-92b2-673def33497c","Type":"ContainerStarted","Data":"539d80838de58a251c789cbd4282d4ef3ddaee974f9865b69c79e2c72a165c07"}
Jun 03 00:56:25.820749 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.820711    2551 generic.go:358] "Generic (PLEG): container finished" podID="74b31ea8-6264-4e04-92b2-673def33497c" containerID="b40fa37cdf6461dc15131dcf8c3182a5da6f350d70240ee9e2d53cb7813831d8" exitCode=0
Jun 03 00:56:25.821157 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.820777    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7" event={"ID":"74b31ea8-6264-4e04-92b2-673def33497c","Type":"ContainerDied","Data":"b40fa37cdf6461dc15131dcf8c3182a5da6f350d70240ee9e2d53cb7813831d8"}
Jun 03 00:56:25.822731 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.822711    2551 generic.go:358] "Generic (PLEG): container finished" podID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerID="e3e18546b6166fe26387f5b75e02a1c1cbd44f9ffe0c42f10fc560b047af0105" exitCode=0
Jun 03 00:56:25.822830 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.822806    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw" event={"ID":"1df20887-830d-4ef4-846c-7e0ace5e2c37","Type":"ContainerDied","Data":"e3e18546b6166fe26387f5b75e02a1c1cbd44f9ffe0c42f10fc560b047af0105"}
Jun 03 00:56:25.824764 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.824741    2551 generic.go:358] "Generic (PLEG): container finished" podID="290ca5c7-b781-4570-83c0-82ce525d5722" containerID="f2db4e5351a01ed4f3c1c65c11d2a4b9220787e7d33c10205fe86c1cb7bb99aa" exitCode=0
Jun 03 00:56:25.824861 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.824812    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t" event={"ID":"290ca5c7-b781-4570-83c0-82ce525d5722","Type":"ContainerDied","Data":"f2db4e5351a01ed4f3c1c65c11d2a4b9220787e7d33c10205fe86c1cb7bb99aa"}
Jun 03 00:56:25.826355 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.826337    2551 generic.go:358] "Generic (PLEG): container finished" podID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerID="3e6834f9d36ea4f4d3099dfca497cb70279dba45c19e35c55167ea552795782b" exitCode=0
Jun 03 00:56:25.826414 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:25.826383    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49" event={"ID":"a023d55f-50b3-46ab-9d6d-7d041c71df61","Type":"ContainerDied","Data":"3e6834f9d36ea4f4d3099dfca497cb70279dba45c19e35c55167ea552795782b"}
Jun 03 00:56:26.832375 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:26.832336    2551 generic.go:358] "Generic (PLEG): container finished" podID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerID="ac0cc6d849e2aa561f8e501a88a630c2cd505e01d84a5a485a8cca7f11661294" exitCode=0
Jun 03 00:56:26.832803 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:26.832405    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49" event={"ID":"a023d55f-50b3-46ab-9d6d-7d041c71df61","Type":"ContainerDied","Data":"ac0cc6d849e2aa561f8e501a88a630c2cd505e01d84a5a485a8cca7f11661294"}
Jun 03 00:56:26.834335 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:26.834299    2551 generic.go:358] "Generic (PLEG): container finished" podID="74b31ea8-6264-4e04-92b2-673def33497c" containerID="7243c30b25b741b23dccb0e89fa496b9501de6ff16e9ebc9fc878f98f6afe9ca" exitCode=0
Jun 03 00:56:26.834335 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:26.834329    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7" event={"ID":"74b31ea8-6264-4e04-92b2-673def33497c","Type":"ContainerDied","Data":"7243c30b25b741b23dccb0e89fa496b9501de6ff16e9ebc9fc878f98f6afe9ca"}
Jun 03 00:56:26.986139 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:26.986112    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:27.017526 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.017504    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:27.027949 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.027924    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5rxp\" (UniqueName: \"kubernetes.io/projected/290ca5c7-b781-4570-83c0-82ce525d5722-kube-api-access-w5rxp\") pod \"290ca5c7-b781-4570-83c0-82ce525d5722\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") "
Jun 03 00:56:27.028063 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.027963    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-bundle\") pod \"290ca5c7-b781-4570-83c0-82ce525d5722\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") "
Jun 03 00:56:27.028063 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.028000    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-bundle\") pod \"1df20887-830d-4ef4-846c-7e0ace5e2c37\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") "
Jun 03 00:56:27.028063 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.028024    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmq6f\" (UniqueName: \"kubernetes.io/projected/1df20887-830d-4ef4-846c-7e0ace5e2c37-kube-api-access-nmq6f\") pod \"1df20887-830d-4ef4-846c-7e0ace5e2c37\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") "
Jun 03 00:56:27.028063 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.028042    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-util\") pod \"1df20887-830d-4ef4-846c-7e0ace5e2c37\" (UID: \"1df20887-830d-4ef4-846c-7e0ace5e2c37\") "
Jun 03 00:56:27.028286 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.028093    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-util\") pod \"290ca5c7-b781-4570-83c0-82ce525d5722\" (UID: \"290ca5c7-b781-4570-83c0-82ce525d5722\") "
Jun 03 00:56:27.028603 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.028512    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-bundle" (OuterVolumeSpecName: "bundle") pod "290ca5c7-b781-4570-83c0-82ce525d5722" (UID: "290ca5c7-b781-4570-83c0-82ce525d5722"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:27.028603 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.028538    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-bundle" (OuterVolumeSpecName: "bundle") pod "1df20887-830d-4ef4-846c-7e0ace5e2c37" (UID: "1df20887-830d-4ef4-846c-7e0ace5e2c37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:27.030418 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.030395    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/290ca5c7-b781-4570-83c0-82ce525d5722-kube-api-access-w5rxp" (OuterVolumeSpecName: "kube-api-access-w5rxp") pod "290ca5c7-b781-4570-83c0-82ce525d5722" (UID: "290ca5c7-b781-4570-83c0-82ce525d5722"). InnerVolumeSpecName "kube-api-access-w5rxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:56:27.030643 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.030620    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df20887-830d-4ef4-846c-7e0ace5e2c37-kube-api-access-nmq6f" (OuterVolumeSpecName: "kube-api-access-nmq6f") pod "1df20887-830d-4ef4-846c-7e0ace5e2c37" (UID: "1df20887-830d-4ef4-846c-7e0ace5e2c37"). InnerVolumeSpecName "kube-api-access-nmq6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:56:27.034768 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.034744    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-util" (OuterVolumeSpecName: "util") pod "1df20887-830d-4ef4-846c-7e0ace5e2c37" (UID: "1df20887-830d-4ef4-846c-7e0ace5e2c37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:27.035268 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.035243    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-util" (OuterVolumeSpecName: "util") pod "290ca5c7-b781-4570-83c0-82ce525d5722" (UID: "290ca5c7-b781-4570-83c0-82ce525d5722"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:27.129523 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.129474    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:27.129523 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.129522    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmq6f\" (UniqueName: \"kubernetes.io/projected/1df20887-830d-4ef4-846c-7e0ace5e2c37-kube-api-access-nmq6f\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:27.129523 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.129533    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1df20887-830d-4ef4-846c-7e0ace5e2c37-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:27.129801 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.129542    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:27.129801 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.129552    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5rxp\" (UniqueName: \"kubernetes.io/projected/290ca5c7-b781-4570-83c0-82ce525d5722-kube-api-access-w5rxp\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:27.129801 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.129562    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/290ca5c7-b781-4570-83c0-82ce525d5722-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:27.839964 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.839932    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t"
Jun 03 00:56:27.839964 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.839954    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t" event={"ID":"290ca5c7-b781-4570-83c0-82ce525d5722","Type":"ContainerDied","Data":"eb1e67a1a7e2c0f08640f23f807d5615eb518c79bd3e5c295fc3f694708ee939"}
Jun 03 00:56:27.840438 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.839987    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb1e67a1a7e2c0f08640f23f807d5615eb518c79bd3e5c295fc3f694708ee939"
Jun 03 00:56:27.841859 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.841774    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw" event={"ID":"1df20887-830d-4ef4-846c-7e0ace5e2c37","Type":"ContainerDied","Data":"2abc73c93140730e0142e245712f9ffb47d6c3784c69a4ac464b28e9c67719b4"}
Jun 03 00:56:27.841859 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.841804    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2abc73c93140730e0142e245712f9ffb47d6c3784c69a4ac464b28e9c67719b4"
Jun 03 00:56:27.842054 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.842037    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw"
Jun 03 00:56:27.996294 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.996272    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:27.999237 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:27.999216    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:28.035473 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.035444    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-bundle\") pod \"74b31ea8-6264-4e04-92b2-673def33497c\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") "
Jun 03 00:56:28.035648 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.035481    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-util\") pod \"74b31ea8-6264-4e04-92b2-673def33497c\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") "
Jun 03 00:56:28.035648 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.035518    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf9m6\" (UniqueName: \"kubernetes.io/projected/a023d55f-50b3-46ab-9d6d-7d041c71df61-kube-api-access-sf9m6\") pod \"a023d55f-50b3-46ab-9d6d-7d041c71df61\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") "
Jun 03 00:56:28.035648 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.035539    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-bundle\") pod \"a023d55f-50b3-46ab-9d6d-7d041c71df61\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") "
Jun 03 00:56:28.035648 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.035561    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-util\") pod \"a023d55f-50b3-46ab-9d6d-7d041c71df61\" (UID: \"a023d55f-50b3-46ab-9d6d-7d041c71df61\") "
Jun 03 00:56:28.035648 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.035591    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcn5s\" (UniqueName: \"kubernetes.io/projected/74b31ea8-6264-4e04-92b2-673def33497c-kube-api-access-kcn5s\") pod \"74b31ea8-6264-4e04-92b2-673def33497c\" (UID: \"74b31ea8-6264-4e04-92b2-673def33497c\") "
Jun 03 00:56:28.036532 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.036499    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-bundle" (OuterVolumeSpecName: "bundle") pod "74b31ea8-6264-4e04-92b2-673def33497c" (UID: "74b31ea8-6264-4e04-92b2-673def33497c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:28.036628 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.036500    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-bundle" (OuterVolumeSpecName: "bundle") pod "a023d55f-50b3-46ab-9d6d-7d041c71df61" (UID: "a023d55f-50b3-46ab-9d6d-7d041c71df61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:28.038055 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.038020    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b31ea8-6264-4e04-92b2-673def33497c-kube-api-access-kcn5s" (OuterVolumeSpecName: "kube-api-access-kcn5s") pod "74b31ea8-6264-4e04-92b2-673def33497c" (UID: "74b31ea8-6264-4e04-92b2-673def33497c"). InnerVolumeSpecName "kube-api-access-kcn5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:56:28.039426 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.039402    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a023d55f-50b3-46ab-9d6d-7d041c71df61-kube-api-access-sf9m6" (OuterVolumeSpecName: "kube-api-access-sf9m6") pod "a023d55f-50b3-46ab-9d6d-7d041c71df61" (UID: "a023d55f-50b3-46ab-9d6d-7d041c71df61"). InnerVolumeSpecName "kube-api-access-sf9m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:56:28.042683 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.042646    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-util" (OuterVolumeSpecName: "util") pod "74b31ea8-6264-4e04-92b2-673def33497c" (UID: "74b31ea8-6264-4e04-92b2-673def33497c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:28.044655 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.044606    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-util" (OuterVolumeSpecName: "util") pod "a023d55f-50b3-46ab-9d6d-7d041c71df61" (UID: "a023d55f-50b3-46ab-9d6d-7d041c71df61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:56:28.136199 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.136154    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:28.136199 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.136193    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74b31ea8-6264-4e04-92b2-673def33497c-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:28.136199 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.136206    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf9m6\" (UniqueName: \"kubernetes.io/projected/a023d55f-50b3-46ab-9d6d-7d041c71df61-kube-api-access-sf9m6\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:28.136476 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.136222    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:28.136476 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.136235    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a023d55f-50b3-46ab-9d6d-7d041c71df61-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:28.136476 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.136247    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcn5s\" (UniqueName: \"kubernetes.io/projected/74b31ea8-6264-4e04-92b2-673def33497c-kube-api-access-kcn5s\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:28.846720 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.846688    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49"
Jun 03 00:56:28.847226 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.846689    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49" event={"ID":"a023d55f-50b3-46ab-9d6d-7d041c71df61","Type":"ContainerDied","Data":"be537c79c8410fd2199e78d81a041010d83ce4fdd2f29031b7f3d723a4a67701"}
Jun 03 00:56:28.847226 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.846798    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be537c79c8410fd2199e78d81a041010d83ce4fdd2f29031b7f3d723a4a67701"
Jun 03 00:56:28.848353 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.848335    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7"
Jun 03 00:56:28.848353 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.848342    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7" event={"ID":"74b31ea8-6264-4e04-92b2-673def33497c","Type":"ContainerDied","Data":"539d80838de58a251c789cbd4282d4ef3ddaee974f9865b69c79e2c72a165c07"}
Jun 03 00:56:28.848528 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:28.848364    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="539d80838de58a251c789cbd4282d4ef3ddaee974f9865b69c79e2c72a165c07"
Jun 03 00:56:44.658584 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658543    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"]
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658913    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658924    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658932    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="290ca5c7-b781-4570-83c0-82ce525d5722" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658937    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="290ca5c7-b781-4570-83c0-82ce525d5722" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658950    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="290ca5c7-b781-4570-83c0-82ce525d5722" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658956    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="290ca5c7-b781-4570-83c0-82ce525d5722" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658965    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b31ea8-6264-4e04-92b2-673def33497c" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658970    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b31ea8-6264-4e04-92b2-673def33497c" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658980    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658985    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658991    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b31ea8-6264-4e04-92b2-673def33497c" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.658997    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b31ea8-6264-4e04-92b2-673def33497c" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659004    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="290ca5c7-b781-4570-83c0-82ce525d5722" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659009    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="290ca5c7-b781-4570-83c0-82ce525d5722" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659015    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b31ea8-6264-4e04-92b2-673def33497c" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659019    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b31ea8-6264-4e04-92b2-673def33497c" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659025    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659030    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659039    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659044    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659052    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659057    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerName="util"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659062    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659067    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerName="pull"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659115    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="74b31ea8-6264-4e04-92b2-673def33497c" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659122    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="1df20887-830d-4ef4-846c-7e0ace5e2c37" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659130    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="a023d55f-50b3-46ab-9d6d-7d041c71df61" containerName="extract"
Jun 03 00:56:44.659154 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.659136    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="290ca5c7-b781-4570-83c0-82ce525d5722" containerName="extract"
Jun 03 00:56:44.669552 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.669522    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"
Jun 03 00:56:44.674958 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.674921    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 00:56:44.675087 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.674972    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6tcm4\""
Jun 03 00:56:44.676502 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.676465    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jun 03 00:56:44.676626 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.676468    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 00:56:44.680213 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.680189    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"]
Jun 03 00:56:44.764003 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.763961    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc6dv\" (UniqueName: \"kubernetes.io/projected/789ba384-c2dc-46c6-aa5b-89884cacdefd-kube-api-access-zc6dv\") pod \"dns-operator-controller-manager-648d5c98bc-ldkpz\" (UID: \"789ba384-c2dc-46c6-aa5b-89884cacdefd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"
Jun 03 00:56:44.864749 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.864715    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc6dv\" (UniqueName: \"kubernetes.io/projected/789ba384-c2dc-46c6-aa5b-89884cacdefd-kube-api-access-zc6dv\") pod \"dns-operator-controller-manager-648d5c98bc-ldkpz\" (UID: \"789ba384-c2dc-46c6-aa5b-89884cacdefd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"
Jun 03 00:56:44.895448 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.895415    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc6dv\" (UniqueName: \"kubernetes.io/projected/789ba384-c2dc-46c6-aa5b-89884cacdefd-kube-api-access-zc6dv\") pod \"dns-operator-controller-manager-648d5c98bc-ldkpz\" (UID: \"789ba384-c2dc-46c6-aa5b-89884cacdefd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"
Jun 03 00:56:44.980863 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:44.980778    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"
Jun 03 00:56:45.116584 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:45.116549    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"]
Jun 03 00:56:45.118039 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:56:45.118011    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789ba384_c2dc_46c6_aa5b_89884cacdefd.slice/crio-b9d21cadec1b019697b6071620c546cbcd80df6dec8a2112c8daa829ef887636 WatchSource:0}: Error finding container b9d21cadec1b019697b6071620c546cbcd80df6dec8a2112c8daa829ef887636: Status 404 returned error can't find the container with id b9d21cadec1b019697b6071620c546cbcd80df6dec8a2112c8daa829ef887636
Jun 03 00:56:45.915026 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:45.914983    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz" event={"ID":"789ba384-c2dc-46c6-aa5b-89884cacdefd","Type":"ContainerStarted","Data":"b9d21cadec1b019697b6071620c546cbcd80df6dec8a2112c8daa829ef887636"}
Jun 03 00:56:47.924885 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:47.924839    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz" event={"ID":"789ba384-c2dc-46c6-aa5b-89884cacdefd","Type":"ContainerStarted","Data":"e785ad37cd1bbac9579af59614dcde2d6fd8da1baa1044299925e13f6fdbc1d2"}
Jun 03 00:56:47.925266 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:47.924924    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"
Jun 03 00:56:47.945068 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:47.945018    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz" podStartSLOduration=1.856751507 podStartE2EDuration="3.945001805s" podCreationTimestamp="2026-06-03 00:56:44 +0000 UTC" firstStartedPulling="2026-06-03 00:56:45.119820346 +0000 UTC m=+466.446329631" lastFinishedPulling="2026-06-03 00:56:47.208070641 +0000 UTC m=+468.534579929" observedRunningTime="2026-06-03 00:56:47.943004706 +0000 UTC m=+469.269514014" watchObservedRunningTime="2026-06-03 00:56:47.945001805 +0000 UTC m=+469.271511112"
Jun 03 00:56:48.390294 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.390256    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"]
Jun 03 00:56:48.393928 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.393903    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:48.396580 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.396555    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6bpt6\""
Jun 03 00:56:48.402846 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.402821    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"]
Jun 03 00:56:48.493462 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.493422    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655xt\" (UniqueName: \"kubernetes.io/projected/78997fdf-95fb-4b49-8e6f-61a6557734b1-kube-api-access-655xt\") pod \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" (UID: \"78997fdf-95fb-4b49-8e6f-61a6557734b1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:48.594044 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.593998    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-655xt\" (UniqueName: \"kubernetes.io/projected/78997fdf-95fb-4b49-8e6f-61a6557734b1-kube-api-access-655xt\") pod \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" (UID: \"78997fdf-95fb-4b49-8e6f-61a6557734b1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:48.602834 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.602814    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-655xt\" (UniqueName: \"kubernetes.io/projected/78997fdf-95fb-4b49-8e6f-61a6557734b1-kube-api-access-655xt\") pod \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" (UID: \"78997fdf-95fb-4b49-8e6f-61a6557734b1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:48.705029 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.704930    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:48.853938 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.853907    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"]
Jun 03 00:56:48.854573 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:56:48.854540    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78997fdf_95fb_4b49_8e6f_61a6557734b1.slice/crio-e28b97974d95c20f36060dcf07736b04e52ea604fb0403b73248e6061b1a9e71 WatchSource:0}: Error finding container e28b97974d95c20f36060dcf07736b04e52ea604fb0403b73248e6061b1a9e71: Status 404 returned error can't find the container with id e28b97974d95c20f36060dcf07736b04e52ea604fb0403b73248e6061b1a9e71
Jun 03 00:56:48.930750 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:48.930707    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" event={"ID":"78997fdf-95fb-4b49-8e6f-61a6557734b1","Type":"ContainerStarted","Data":"e28b97974d95c20f36060dcf07736b04e52ea604fb0403b73248e6061b1a9e71"}
Jun 03 00:56:51.944483 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:51.944447    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" event={"ID":"78997fdf-95fb-4b49-8e6f-61a6557734b1","Type":"ContainerStarted","Data":"b9ffe1b87cb905d0958f88b5a38f6f76d7284481c9f5709996437d7f880c5e8d"}
Jun 03 00:56:51.944891 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:51.944532    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:51.962118 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:51.962071    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" podStartSLOduration=1.919872453 podStartE2EDuration="3.962057478s" podCreationTimestamp="2026-06-03 00:56:48 +0000 UTC" firstStartedPulling="2026-06-03 00:56:48.85668109 +0000 UTC m=+470.183190375" lastFinishedPulling="2026-06-03 00:56:50.898866115 +0000 UTC m=+472.225375400" observedRunningTime="2026-06-03 00:56:51.959836898 +0000 UTC m=+473.286346205" watchObservedRunningTime="2026-06-03 00:56:51.962057478 +0000 UTC m=+473.288566859"
Jun 03 00:56:56.132593 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:56.132554    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8d7595bf-6wzz5"]
Jun 03 00:56:58.753455 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.753420    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"]
Jun 03 00:56:58.753883 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.753689    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" containerName="manager" containerID="cri-o://b9ffe1b87cb905d0958f88b5a38f6f76d7284481c9f5709996437d7f880c5e8d" gracePeriod=2
Jun 03 00:56:58.755613 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.755591    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:58.762026 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.762002    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"]
Jun 03 00:56:58.763744 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.763711    2551 status_manager.go:895] "Failed to get status for pod" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" err="pods \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" is forbidden: User \"system:node:ip-10-0-141-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-62.ec2.internal' and this object"
Jun 03 00:56:58.772421 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.772392    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"]
Jun 03 00:56:58.772857 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.772838    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" containerName="manager"
Jun 03 00:56:58.772857 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.772856    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" containerName="manager"
Jun 03 00:56:58.773110 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.772926    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" containerName="manager"
Jun 03 00:56:58.775900 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.775875    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"
Jun 03 00:56:58.787059 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.786576    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"]
Jun 03 00:56:58.810010 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.809971    2551 status_manager.go:895] "Failed to get status for pod" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" err="pods \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" is forbidden: User \"system:node:ip-10-0-141-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-62.ec2.internal' and this object"
Jun 03 00:56:58.890064 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.890015    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb7vp\" (UniqueName: \"kubernetes.io/projected/344b5470-514c-4292-b745-7554af2065ba-kube-api-access-pb7vp\") pod \"limitador-operator-controller-manager-85c4996f8c-qtzhr\" (UID: \"344b5470-514c-4292-b745-7554af2065ba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"
Jun 03 00:56:58.934036 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.934010    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldkpz"
Jun 03 00:56:58.957856 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.957818    2551 status_manager.go:895] "Failed to get status for pod" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" err="pods \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" is forbidden: User \"system:node:ip-10-0-141-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-62.ec2.internal' and this object"
Jun 03 00:56:58.973020 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.972988    2551 generic.go:358] "Generic (PLEG): container finished" podID="78997fdf-95fb-4b49-8e6f-61a6557734b1" containerID="b9ffe1b87cb905d0958f88b5a38f6f76d7284481c9f5709996437d7f880c5e8d" exitCode=0
Jun 03 00:56:58.990785 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.990754    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pb7vp\" (UniqueName: \"kubernetes.io/projected/344b5470-514c-4292-b745-7554af2065ba-kube-api-access-pb7vp\") pod \"limitador-operator-controller-manager-85c4996f8c-qtzhr\" (UID: \"344b5470-514c-4292-b745-7554af2065ba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"
Jun 03 00:56:58.998517 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.998493    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:58.999644 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:58.999621    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb7vp\" (UniqueName: \"kubernetes.io/projected/344b5470-514c-4292-b745-7554af2065ba-kube-api-access-pb7vp\") pod \"limitador-operator-controller-manager-85c4996f8c-qtzhr\" (UID: \"344b5470-514c-4292-b745-7554af2065ba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"
Jun 03 00:56:59.000922 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.000899    2551 status_manager.go:895] "Failed to get status for pod" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" err="pods \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" is forbidden: User \"system:node:ip-10-0-141-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-62.ec2.internal' and this object"
Jun 03 00:56:59.091938 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.091854    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-655xt\" (UniqueName: \"kubernetes.io/projected/78997fdf-95fb-4b49-8e6f-61a6557734b1-kube-api-access-655xt\") pod \"78997fdf-95fb-4b49-8e6f-61a6557734b1\" (UID: \"78997fdf-95fb-4b49-8e6f-61a6557734b1\") "
Jun 03 00:56:59.093999 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.093967    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78997fdf-95fb-4b49-8e6f-61a6557734b1-kube-api-access-655xt" (OuterVolumeSpecName: "kube-api-access-655xt") pod "78997fdf-95fb-4b49-8e6f-61a6557734b1" (UID: "78997fdf-95fb-4b49-8e6f-61a6557734b1"). InnerVolumeSpecName "kube-api-access-655xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:56:59.137400 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.137362    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"
Jun 03 00:56:59.193333 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.193288    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-655xt\" (UniqueName: \"kubernetes.io/projected/78997fdf-95fb-4b49-8e6f-61a6557734b1-kube-api-access-655xt\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:56:59.226341 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.226291    2551 status_manager.go:895] "Failed to get status for pod" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp" err="pods \"limitador-operator-controller-manager-85c4996f8c-jm7bp\" is forbidden: User \"system:node:ip-10-0-141-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-62.ec2.internal' and this object"
Jun 03 00:56:59.228417 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.228393    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78997fdf-95fb-4b49-8e6f-61a6557734b1" path="/var/lib/kubelet/pods/78997fdf-95fb-4b49-8e6f-61a6557734b1/volumes"
Jun 03 00:56:59.280540 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.280510    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"]
Jun 03 00:56:59.282072 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:56:59.282046    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344b5470_514c_4292_b745_7554af2065ba.slice/crio-6a05adf1bb68fa5032e02e0d5bfc5b891542c45a9c893f3bc1b01b01de4e2255 WatchSource:0}: Error finding container 6a05adf1bb68fa5032e02e0d5bfc5b891542c45a9c893f3bc1b01b01de4e2255: Status 404 returned error can't find the container with id 6a05adf1bb68fa5032e02e0d5bfc5b891542c45a9c893f3bc1b01b01de4e2255
Jun 03 00:56:59.978539 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.978505    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jm7bp"
Jun 03 00:56:59.978539 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.978521    2551 scope.go:117] "RemoveContainer" containerID="b9ffe1b87cb905d0958f88b5a38f6f76d7284481c9f5709996437d7f880c5e8d"
Jun 03 00:56:59.980168 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.980134    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr" event={"ID":"344b5470-514c-4292-b745-7554af2065ba","Type":"ContainerStarted","Data":"fb9585fc22006fbac3d90f3f644fc84eee67aa6ee9a7348a31b314a4fc7ea965"}
Jun 03 00:56:59.980280 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.980175    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr" event={"ID":"344b5470-514c-4292-b745-7554af2065ba","Type":"ContainerStarted","Data":"6a05adf1bb68fa5032e02e0d5bfc5b891542c45a9c893f3bc1b01b01de4e2255"}
Jun 03 00:56:59.980280 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:56:59.980273    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"
Jun 03 00:57:00.003789 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.003736    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr" podStartSLOduration=2.003719665 podStartE2EDuration="2.003719665s" podCreationTimestamp="2026-06-03 00:56:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:57:00.001900786 +0000 UTC m=+481.328410093" watchObservedRunningTime="2026-06-03 00:57:00.003719665 +0000 UTC m=+481.330229037"
Jun 03 00:57:00.706273 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.706243    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"]
Jun 03 00:57:00.711117 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.711095    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:00.713763 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.713743    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-knd2h\""
Jun 03 00:57:00.722159 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.722129    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"]
Jun 03 00:57:00.809194 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.809156    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78100fc6-f87e-433e-9a44-d2f1bfc7bc86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8mrs\" (UID: \"78100fc6-f87e-433e-9a44-d2f1bfc7bc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:00.809194 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.809193    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blckk\" (UniqueName: \"kubernetes.io/projected/78100fc6-f87e-433e-9a44-d2f1bfc7bc86-kube-api-access-blckk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8mrs\" (UID: \"78100fc6-f87e-433e-9a44-d2f1bfc7bc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:00.909973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.909935    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78100fc6-f87e-433e-9a44-d2f1bfc7bc86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8mrs\" (UID: \"78100fc6-f87e-433e-9a44-d2f1bfc7bc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:00.909973 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.909977    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blckk\" (UniqueName: \"kubernetes.io/projected/78100fc6-f87e-433e-9a44-d2f1bfc7bc86-kube-api-access-blckk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8mrs\" (UID: \"78100fc6-f87e-433e-9a44-d2f1bfc7bc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:00.910321 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.910301    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78100fc6-f87e-433e-9a44-d2f1bfc7bc86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8mrs\" (UID: \"78100fc6-f87e-433e-9a44-d2f1bfc7bc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:00.919853 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:00.919825    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blckk\" (UniqueName: \"kubernetes.io/projected/78100fc6-f87e-433e-9a44-d2f1bfc7bc86-kube-api-access-blckk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8mrs\" (UID: \"78100fc6-f87e-433e-9a44-d2f1bfc7bc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:01.022503 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:01.022406    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:01.161949 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:01.161919    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"]
Jun 03 00:57:01.163593 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:57:01.163562    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78100fc6_f87e_433e_9a44_d2f1bfc7bc86.slice/crio-f8faf7912a2e4900a7a825c0d4bd16897edc090da1b2bf29622074e267354a67 WatchSource:0}: Error finding container f8faf7912a2e4900a7a825c0d4bd16897edc090da1b2bf29622074e267354a67: Status 404 returned error can't find the container with id f8faf7912a2e4900a7a825c0d4bd16897edc090da1b2bf29622074e267354a67
Jun 03 00:57:01.993654 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:01.993613    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs" event={"ID":"78100fc6-f87e-433e-9a44-d2f1bfc7bc86","Type":"ContainerStarted","Data":"f8faf7912a2e4900a7a825c0d4bd16897edc090da1b2bf29622074e267354a67"}
Jun 03 00:57:06.011515 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:06.011471    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs" event={"ID":"78100fc6-f87e-433e-9a44-d2f1bfc7bc86","Type":"ContainerStarted","Data":"aaa29d4c4431ea6ee2a3558d4ee07cd88c6ffc7baaf1ec2516f120eb7838ef1f"}
Jun 03 00:57:06.011953 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:06.011542    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:06.051782 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:06.051729    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs" podStartSLOduration=2.119812271 podStartE2EDuration="6.05171428s" podCreationTimestamp="2026-06-03 00:57:00 +0000 UTC" firstStartedPulling="2026-06-03 00:57:01.166150914 +0000 UTC m=+482.492660199" lastFinishedPulling="2026-06-03 00:57:05.098052921 +0000 UTC m=+486.424562208" observedRunningTime="2026-06-03 00:57:06.048831466 +0000 UTC m=+487.375340773" watchObservedRunningTime="2026-06-03 00:57:06.05171428 +0000 UTC m=+487.378223587"
Jun 03 00:57:10.987168 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:10.987134    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtzhr"
Jun 03 00:57:17.018262 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:17.018229    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8mrs"
Jun 03 00:57:21.159800 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.159760    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b8d7595bf-6wzz5" podUID="3da55f0a-c5ab-4701-a720-c2932cda9408" containerName="console" containerID="cri-o://0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1" gracePeriod=15
Jun 03 00:57:21.404786 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.404764    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b8d7595bf-6wzz5_3da55f0a-c5ab-4701-a720-c2932cda9408/console/0.log"
Jun 03 00:57:21.404910 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.404827    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:57:21.499416 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499318    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-console-config\") pod \"3da55f0a-c5ab-4701-a720-c2932cda9408\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") "
Jun 03 00:57:21.499416 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499361    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-service-ca\") pod \"3da55f0a-c5ab-4701-a720-c2932cda9408\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") "
Jun 03 00:57:21.499416 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499398    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-oauth-config\") pod \"3da55f0a-c5ab-4701-a720-c2932cda9408\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") "
Jun 03 00:57:21.499722 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499449    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-oauth-serving-cert\") pod \"3da55f0a-c5ab-4701-a720-c2932cda9408\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") "
Jun 03 00:57:21.499722 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499477    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-trusted-ca-bundle\") pod \"3da55f0a-c5ab-4701-a720-c2932cda9408\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") "
Jun 03 00:57:21.499722 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499511    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqwsp\" (UniqueName: \"kubernetes.io/projected/3da55f0a-c5ab-4701-a720-c2932cda9408-kube-api-access-rqwsp\") pod \"3da55f0a-c5ab-4701-a720-c2932cda9408\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") "
Jun 03 00:57:21.499722 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499551    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-serving-cert\") pod \"3da55f0a-c5ab-4701-a720-c2932cda9408\" (UID: \"3da55f0a-c5ab-4701-a720-c2932cda9408\") "
Jun 03 00:57:21.499903 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499851    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-console-config" (OuterVolumeSpecName: "console-config") pod "3da55f0a-c5ab-4701-a720-c2932cda9408" (UID: "3da55f0a-c5ab-4701-a720-c2932cda9408"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:57:21.499903 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499868    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-service-ca" (OuterVolumeSpecName: "service-ca") pod "3da55f0a-c5ab-4701-a720-c2932cda9408" (UID: "3da55f0a-c5ab-4701-a720-c2932cda9408"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:57:21.499903 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.499871    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3da55f0a-c5ab-4701-a720-c2932cda9408" (UID: "3da55f0a-c5ab-4701-a720-c2932cda9408"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:57:21.500217 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.500189    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3da55f0a-c5ab-4701-a720-c2932cda9408" (UID: "3da55f0a-c5ab-4701-a720-c2932cda9408"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 00:57:21.501654 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.501626    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3da55f0a-c5ab-4701-a720-c2932cda9408" (UID: "3da55f0a-c5ab-4701-a720-c2932cda9408"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:57:21.501767 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.501637    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3da55f0a-c5ab-4701-a720-c2932cda9408" (UID: "3da55f0a-c5ab-4701-a720-c2932cda9408"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 00:57:21.501767 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.501742    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da55f0a-c5ab-4701-a720-c2932cda9408-kube-api-access-rqwsp" (OuterVolumeSpecName: "kube-api-access-rqwsp") pod "3da55f0a-c5ab-4701-a720-c2932cda9408" (UID: "3da55f0a-c5ab-4701-a720-c2932cda9408"). InnerVolumeSpecName "kube-api-access-rqwsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:57:21.600652 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.600612    2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-console-config\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:57:21.600652 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.600648    2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-service-ca\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:57:21.600652 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.600676    2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-oauth-config\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:57:21.600948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.600691    2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-oauth-serving-cert\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:57:21.600948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.600723    2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da55f0a-c5ab-4701-a720-c2932cda9408-trusted-ca-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:57:21.600948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.600738    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqwsp\" (UniqueName: \"kubernetes.io/projected/3da55f0a-c5ab-4701-a720-c2932cda9408-kube-api-access-rqwsp\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:57:21.600948 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:21.600752    2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3da55f0a-c5ab-4701-a720-c2932cda9408-console-serving-cert\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:57:22.073976 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.073941    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b8d7595bf-6wzz5_3da55f0a-c5ab-4701-a720-c2932cda9408/console/0.log"
Jun 03 00:57:22.074166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.073987    2551 generic.go:358] "Generic (PLEG): container finished" podID="3da55f0a-c5ab-4701-a720-c2932cda9408" containerID="0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1" exitCode=2
Jun 03 00:57:22.074166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.074050    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d7595bf-6wzz5"
Jun 03 00:57:22.074166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.074071    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d7595bf-6wzz5" event={"ID":"3da55f0a-c5ab-4701-a720-c2932cda9408","Type":"ContainerDied","Data":"0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1"}
Jun 03 00:57:22.074166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.074110    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d7595bf-6wzz5" event={"ID":"3da55f0a-c5ab-4701-a720-c2932cda9408","Type":"ContainerDied","Data":"97e348cc81a2741b0d5fcdf45979c7fb5b2189f167063c090a8e399ed2664605"}
Jun 03 00:57:22.074166 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.074126    2551 scope.go:117] "RemoveContainer" containerID="0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1"
Jun 03 00:57:22.083246 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.083229    2551 scope.go:117] "RemoveContainer" containerID="0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1"
Jun 03 00:57:22.083494 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:57:22.083472    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1\": container with ID starting with 0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1 not found: ID does not exist" containerID="0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1"
Jun 03 00:57:22.083561 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.083502    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1"} err="failed to get container status \"0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1\": rpc error: code = NotFound desc = could not find container \"0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1\": container with ID starting with 0df933fb54f4cb994bba8e24a7c6e3fba407b1bee74fc2f08d0263b493e4b4b1 not found: ID does not exist"
Jun 03 00:57:22.096401 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.096370    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8d7595bf-6wzz5"]
Jun 03 00:57:22.100058 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:22.100032    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b8d7595bf-6wzz5"]
Jun 03 00:57:23.224388 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:57:23.224355    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da55f0a-c5ab-4701-a720-c2932cda9408" path="/var/lib/kubelet/pods/3da55f0a-c5ab-4701-a720-c2932cda9408/volumes"
Jun 03 00:58:02.802864 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.802818    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"]
Jun 03 00:58:02.803384 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.803368    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da55f0a-c5ab-4701-a720-c2932cda9408" containerName="console"
Jun 03 00:58:02.803459 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.803388    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da55f0a-c5ab-4701-a720-c2932cda9408" containerName="console"
Jun 03 00:58:02.803513 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.803486    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="3da55f0a-c5ab-4701-a720-c2932cda9408" containerName="console"
Jun 03 00:58:02.808108 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.808086    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:02.811131 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.811107    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 00:58:02.812348 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.812323    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 00:58:02.812484 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.812445    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l24zp\""
Jun 03 00:58:02.815777 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.815752    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"]
Jun 03 00:58:02.974826 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.974789    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h94h7\" (UniqueName: \"kubernetes.io/projected/5bc7b4c4-fa5d-454d-98c0-84e62b183643-kube-api-access-h94h7\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:02.974998 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.974856    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:02.974998 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:02.974898    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.076301 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.076213    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.076301 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.076259    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.076483 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.076311    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h94h7\" (UniqueName: \"kubernetes.io/projected/5bc7b4c4-fa5d-454d-98c0-84e62b183643-kube-api-access-h94h7\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.076628 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.076607    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.076703 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.076629    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.089392 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.089356    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h94h7\" (UniqueName: \"kubernetes.io/projected/5bc7b4c4-fa5d-454d-98c0-84e62b183643-kube-api-access-h94h7\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.118361 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.118314    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:03.257771 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:03.257746    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"]
Jun 03 00:58:03.259973 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:58:03.259938    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc7b4c4_fa5d_454d_98c0_84e62b183643.slice/crio-0e90538de8e14c55da6ef2398a3f7b6f3ce4efb89b453570088e1f327930236c WatchSource:0}: Error finding container 0e90538de8e14c55da6ef2398a3f7b6f3ce4efb89b453570088e1f327930236c: Status 404 returned error can't find the container with id 0e90538de8e14c55da6ef2398a3f7b6f3ce4efb89b453570088e1f327930236c
Jun 03 00:58:04.240477 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:04.240437    2551 generic.go:358] "Generic (PLEG): container finished" podID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerID="b605b1d9e78aafb66937145e0b294394a86c2cc8328d88d7822dd672f1ec2119" exitCode=0
Jun 03 00:58:04.240861 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:04.240482    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8" event={"ID":"5bc7b4c4-fa5d-454d-98c0-84e62b183643","Type":"ContainerDied","Data":"b605b1d9e78aafb66937145e0b294394a86c2cc8328d88d7822dd672f1ec2119"}
Jun 03 00:58:04.240861 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:04.240509    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8" event={"ID":"5bc7b4c4-fa5d-454d-98c0-84e62b183643","Type":"ContainerStarted","Data":"0e90538de8e14c55da6ef2398a3f7b6f3ce4efb89b453570088e1f327930236c"}
Jun 03 00:58:05.245904 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:05.245862    2551 generic.go:358] "Generic (PLEG): container finished" podID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerID="22eaacfe782af85fe8bb7e00a5296f04a4677227ed8dba620f51d0c296cf7cde" exitCode=0
Jun 03 00:58:05.246284 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:05.245946    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8" event={"ID":"5bc7b4c4-fa5d-454d-98c0-84e62b183643","Type":"ContainerDied","Data":"22eaacfe782af85fe8bb7e00a5296f04a4677227ed8dba620f51d0c296cf7cde"}
Jun 03 00:58:06.255061 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:06.255028    2551 generic.go:358] "Generic (PLEG): container finished" podID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerID="64c2db1af2f09861ccf6efd237a4a4fcff2248c269ed6bac550339c7e83ad118" exitCode=0
Jun 03 00:58:06.255443 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:06.255131    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8" event={"ID":"5bc7b4c4-fa5d-454d-98c0-84e62b183643","Type":"ContainerDied","Data":"64c2db1af2f09861ccf6efd237a4a4fcff2248c269ed6bac550339c7e83ad118"}
Jun 03 00:58:07.394881 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.394854    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:07.411549 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.411491    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-bundle\") pod \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") "
Jun 03 00:58:07.411549 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.411535    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-util\") pod \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") "
Jun 03 00:58:07.412148 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.412119    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-bundle" (OuterVolumeSpecName: "bundle") pod "5bc7b4c4-fa5d-454d-98c0-84e62b183643" (UID: "5bc7b4c4-fa5d-454d-98c0-84e62b183643"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:58:07.418139 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.418109    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-util" (OuterVolumeSpecName: "util") pod "5bc7b4c4-fa5d-454d-98c0-84e62b183643" (UID: "5bc7b4c4-fa5d-454d-98c0-84e62b183643"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 00:58:07.512887 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.512792    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h94h7\" (UniqueName: \"kubernetes.io/projected/5bc7b4c4-fa5d-454d-98c0-84e62b183643-kube-api-access-h94h7\") pod \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\" (UID: \"5bc7b4c4-fa5d-454d-98c0-84e62b183643\") "
Jun 03 00:58:07.513036 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.512967    2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-bundle\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:58:07.513036 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.512980    2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc7b4c4-fa5d-454d-98c0-84e62b183643-util\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:58:07.514868 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.514842    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc7b4c4-fa5d-454d-98c0-84e62b183643-kube-api-access-h94h7" (OuterVolumeSpecName: "kube-api-access-h94h7") pod "5bc7b4c4-fa5d-454d-98c0-84e62b183643" (UID: "5bc7b4c4-fa5d-454d-98c0-84e62b183643"). InnerVolumeSpecName "kube-api-access-h94h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:58:07.614044 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:07.614008    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h94h7\" (UniqueName: \"kubernetes.io/projected/5bc7b4c4-fa5d-454d-98c0-84e62b183643-kube-api-access-h94h7\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:58:08.264728 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:08.264695    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8" event={"ID":"5bc7b4c4-fa5d-454d-98c0-84e62b183643","Type":"ContainerDied","Data":"0e90538de8e14c55da6ef2398a3f7b6f3ce4efb89b453570088e1f327930236c"}
Jun 03 00:58:08.264728 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:08.264736    2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e90538de8e14c55da6ef2398a3f7b6f3ce4efb89b453570088e1f327930236c"
Jun 03 00:58:08.264943 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:08.264706    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a704djt8"
Jun 03 00:58:31.458995 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.458959    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:58:31.459453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.459298    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerName="extract"
Jun 03 00:58:31.459453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.459309    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerName="extract"
Jun 03 00:58:31.459453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.459321    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerName="pull"
Jun 03 00:58:31.459453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.459326    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerName="pull"
Jun 03 00:58:31.459453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.459335    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerName="util"
Jun 03 00:58:31.459453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.459340    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerName="util"
Jun 03 00:58:31.459453 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.459403    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="5bc7b4c4-fa5d-454d-98c0-84e62b183643" containerName="extract"
Jun 03 00:58:31.462502 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.462483    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:31.465339 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.465313    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 00:58:31.465494 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.465345    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wxr6z\""
Jun 03 00:58:31.465603 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.465588    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 00:58:31.465703 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.465616    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 00:58:31.474555 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.474517    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:58:31.518010 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.517970    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xf25\" (UniqueName: \"kubernetes.io/projected/26bc4221-bde6-489e-aa25-2b64d7aca993-kube-api-access-5xf25\") pod \"maas-keycloak-0\" (UID: \"26bc4221-bde6-489e-aa25-2b64d7aca993\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:31.619373 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.619334    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf25\" (UniqueName: \"kubernetes.io/projected/26bc4221-bde6-489e-aa25-2b64d7aca993-kube-api-access-5xf25\") pod \"maas-keycloak-0\" (UID: \"26bc4221-bde6-489e-aa25-2b64d7aca993\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:31.627946 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.627919    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xf25\" (UniqueName: \"kubernetes.io/projected/26bc4221-bde6-489e-aa25-2b64d7aca993-kube-api-access-5xf25\") pod \"maas-keycloak-0\" (UID: \"26bc4221-bde6-489e-aa25-2b64d7aca993\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:31.773254 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.773154    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:31.908389 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:31.908366    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:58:31.910011 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:58:31.909964    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26bc4221_bde6_489e_aa25_2b64d7aca993.slice/crio-716cbe42ce1eef2d874b873f3e56181aef94ae7e0304c8b3c5f28b22f95cf5ce WatchSource:0}: Error finding container 716cbe42ce1eef2d874b873f3e56181aef94ae7e0304c8b3c5f28b22f95cf5ce: Status 404 returned error can't find the container with id 716cbe42ce1eef2d874b873f3e56181aef94ae7e0304c8b3c5f28b22f95cf5ce
Jun 03 00:58:32.357399 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:32.357353    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26bc4221-bde6-489e-aa25-2b64d7aca993","Type":"ContainerStarted","Data":"716cbe42ce1eef2d874b873f3e56181aef94ae7e0304c8b3c5f28b22f95cf5ce"}
Jun 03 00:58:37.384729 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:37.384687    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26bc4221-bde6-489e-aa25-2b64d7aca993","Type":"ContainerStarted","Data":"d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a"}
Jun 03 00:58:37.404423 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:37.404369    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.119197033 podStartE2EDuration="6.404353021s" podCreationTimestamp="2026-06-03 00:58:31 +0000 UTC" firstStartedPulling="2026-06-03 00:58:31.911209095 +0000 UTC m=+573.237718384" lastFinishedPulling="2026-06-03 00:58:37.196365082 +0000 UTC m=+578.522874372" observedRunningTime="2026-06-03 00:58:37.402215271 +0000 UTC m=+578.728724581" watchObservedRunningTime="2026-06-03 00:58:37.404353021 +0000 UTC m=+578.730862375"
Jun 03 00:58:37.774085 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:37.774043    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:37.776056 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:37.776011    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:38.773707 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:38.773634    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:39.774403 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:39.774342    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:40.773974 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:40.773914    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:41.773408 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:41.773379    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:41.773915 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:41.773712    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:42.773977 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:42.773920    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:43.774338 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:43.774276    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:44.773938 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:44.773889    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:45.774074 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:45.774021    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:46.774456 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:46.774404    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:47.774047 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:47.773991    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:48.774332 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:48.774287    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:49.774496 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:49.774439    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused"
Jun 03 00:58:50.863709 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:50.863646    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:58:50.877750 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:58:50.877704    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 00:59:00.869631 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:00.869593    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:41.092520 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.092470    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7c8889db44-ptkfm"]
Jun 03 00:59:41.096204 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.096183    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.099009 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.098985    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-thxrv\""
Jun 03 00:59:41.099130 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.098984    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 03 00:59:41.104960 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.104928    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7c8889db44-ptkfm"]
Jun 03 00:59:41.267226 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.267187    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2d74377-41c7-408c-81ee-3c864ec5c455-maas-api-tls\") pod \"maas-api-7c8889db44-ptkfm\" (UID: \"b2d74377-41c7-408c-81ee-3c864ec5c455\") " pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.267408 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.267249    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhtbj\" (UniqueName: \"kubernetes.io/projected/b2d74377-41c7-408c-81ee-3c864ec5c455-kube-api-access-fhtbj\") pod \"maas-api-7c8889db44-ptkfm\" (UID: \"b2d74377-41c7-408c-81ee-3c864ec5c455\") " pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.368400 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.368362    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2d74377-41c7-408c-81ee-3c864ec5c455-maas-api-tls\") pod \"maas-api-7c8889db44-ptkfm\" (UID: \"b2d74377-41c7-408c-81ee-3c864ec5c455\") " pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.368593 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.368422    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhtbj\" (UniqueName: \"kubernetes.io/projected/b2d74377-41c7-408c-81ee-3c864ec5c455-kube-api-access-fhtbj\") pod \"maas-api-7c8889db44-ptkfm\" (UID: \"b2d74377-41c7-408c-81ee-3c864ec5c455\") " pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.371072 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.371042    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2d74377-41c7-408c-81ee-3c864ec5c455-maas-api-tls\") pod \"maas-api-7c8889db44-ptkfm\" (UID: \"b2d74377-41c7-408c-81ee-3c864ec5c455\") " pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.379677 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.379634    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhtbj\" (UniqueName: \"kubernetes.io/projected/b2d74377-41c7-408c-81ee-3c864ec5c455-kube-api-access-fhtbj\") pod \"maas-api-7c8889db44-ptkfm\" (UID: \"b2d74377-41c7-408c-81ee-3c864ec5c455\") " pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.408242 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.408213    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:41.550411 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.550315    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7c8889db44-ptkfm"]
Jun 03 00:59:41.554767 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.554743    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 00:59:41.654675 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:41.654582    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7c8889db44-ptkfm" event={"ID":"b2d74377-41c7-408c-81ee-3c864ec5c455","Type":"ContainerStarted","Data":"a6a6f54c9a085bee7669df67507ba04c58bab2a0490360377ed04a6e8194d2b2"}
Jun 03 00:59:44.669637 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:44.669603    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7c8889db44-ptkfm" event={"ID":"b2d74377-41c7-408c-81ee-3c864ec5c455","Type":"ContainerStarted","Data":"4ca6404078aefaf5723b0982553763de0ba8edb8d5b2b36a892792bdd714f8c7"}
Jun 03 00:59:44.670063 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:44.669746    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:44.686546 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:44.686491    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7c8889db44-ptkfm" podStartSLOduration=1.488559467 podStartE2EDuration="3.686475902s" podCreationTimestamp="2026-06-03 00:59:41 +0000 UTC" firstStartedPulling="2026-06-03 00:59:41.554912776 +0000 UTC m=+642.881422060" lastFinishedPulling="2026-06-03 00:59:43.752829194 +0000 UTC m=+645.079338495" observedRunningTime="2026-06-03 00:59:44.685381717 +0000 UTC m=+646.011891023" watchObservedRunningTime="2026-06-03 00:59:44.686475902 +0000 UTC m=+646.012985208"
Jun 03 00:59:50.678567 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:50.678535    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7c8889db44-ptkfm"
Jun 03 00:59:52.467558 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:52.467519    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:59:52.467988 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:52.467792    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak" containerID="cri-o://d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a" gracePeriod=30
Jun 03 00:59:54.120115 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.120089    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.169627 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.169525    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xf25\" (UniqueName: \"kubernetes.io/projected/26bc4221-bde6-489e-aa25-2b64d7aca993-kube-api-access-5xf25\") pod \"26bc4221-bde6-489e-aa25-2b64d7aca993\" (UID: \"26bc4221-bde6-489e-aa25-2b64d7aca993\") "
Jun 03 00:59:54.171946 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.171907    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26bc4221-bde6-489e-aa25-2b64d7aca993-kube-api-access-5xf25" (OuterVolumeSpecName: "kube-api-access-5xf25") pod "26bc4221-bde6-489e-aa25-2b64d7aca993" (UID: "26bc4221-bde6-489e-aa25-2b64d7aca993"). InnerVolumeSpecName "kube-api-access-5xf25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 00:59:54.270727 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.270647    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xf25\" (UniqueName: \"kubernetes.io/projected/26bc4221-bde6-489e-aa25-2b64d7aca993-kube-api-access-5xf25\") on node \"ip-10-0-141-62.ec2.internal\" DevicePath \"\""
Jun 03 00:59:54.711596 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.711559    2551 generic.go:358] "Generic (PLEG): container finished" podID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerID="d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a" exitCode=143
Jun 03 00:59:54.711786 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.711627    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.711786 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.711642    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26bc4221-bde6-489e-aa25-2b64d7aca993","Type":"ContainerDied","Data":"d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a"}
Jun 03 00:59:54.711786 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.711714    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26bc4221-bde6-489e-aa25-2b64d7aca993","Type":"ContainerDied","Data":"716cbe42ce1eef2d874b873f3e56181aef94ae7e0304c8b3c5f28b22f95cf5ce"}
Jun 03 00:59:54.711786 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.711738    2551 scope.go:117] "RemoveContainer" containerID="d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a"
Jun 03 00:59:54.723841 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.723823    2551 scope.go:117] "RemoveContainer" containerID="d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a"
Jun 03 00:59:54.724104 ip-10-0-141-62 kubenswrapper[2551]: E0603 00:59:54.724085    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a\": container with ID starting with d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a not found: ID does not exist" containerID="d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a"
Jun 03 00:59:54.724183 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.724117    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a"} err="failed to get container status \"d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a\": rpc error: code = NotFound desc = could not find container \"d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a\": container with ID starting with d3d6bf5291c36194dc8d04ef51f0c1cab44cb962372bffecc818ed3d32f2600a not found: ID does not exist"
Jun 03 00:59:54.735597 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.735561    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:59:54.739743 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.739709    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:59:54.757281 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.757248    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:59:54.757628 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.757616    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak"
Jun 03 00:59:54.757693 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.757630    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak"
Jun 03 00:59:54.757731 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.757699    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" containerName="keycloak"
Jun 03 00:59:54.762156 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.762137    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.764911 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.764872    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wxr6z\""
Jun 03 00:59:54.765073 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.764957    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 03 00:59:54.765073 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.765000    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 00:59:54.765837 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.765339    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 00:59:54.765837 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.765576    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 00:59:54.769048 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.769026    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:59:54.774217 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.774192    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jmr\" (UniqueName: \"kubernetes.io/projected/c3978df0-4568-4609-8c53-0edf5af784b4-kube-api-access-s4jmr\") pod \"maas-keycloak-0\" (UID: \"c3978df0-4568-4609-8c53-0edf5af784b4\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.774336 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.774274    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c3978df0-4568-4609-8c53-0edf5af784b4-test-realms\") pod \"maas-keycloak-0\" (UID: \"c3978df0-4568-4609-8c53-0edf5af784b4\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.874980 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.874939    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c3978df0-4568-4609-8c53-0edf5af784b4-test-realms\") pod \"maas-keycloak-0\" (UID: \"c3978df0-4568-4609-8c53-0edf5af784b4\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.875150 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.875035    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jmr\" (UniqueName: \"kubernetes.io/projected/c3978df0-4568-4609-8c53-0edf5af784b4-kube-api-access-s4jmr\") pod \"maas-keycloak-0\" (UID: \"c3978df0-4568-4609-8c53-0edf5af784b4\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.875637 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.875616    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c3978df0-4568-4609-8c53-0edf5af784b4-test-realms\") pod \"maas-keycloak-0\" (UID: \"c3978df0-4568-4609-8c53-0edf5af784b4\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:54.884053 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:54.884024    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jmr\" (UniqueName: \"kubernetes.io/projected/c3978df0-4568-4609-8c53-0edf5af784b4-kube-api-access-s4jmr\") pod \"maas-keycloak-0\" (UID: \"c3978df0-4568-4609-8c53-0edf5af784b4\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:55.072311 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:55.072220    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:55.205714 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:55.205686    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 00:59:55.207252 ip-10-0-141-62 kubenswrapper[2551]: W0603 00:59:55.207214    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3978df0_4568_4609_8c53_0edf5af784b4.slice/crio-09e96067b7a2be631553454986bb10c861f3eebb222cdd261957378b8a731c4c WatchSource:0}: Error finding container 09e96067b7a2be631553454986bb10c861f3eebb222cdd261957378b8a731c4c: Status 404 returned error can't find the container with id 09e96067b7a2be631553454986bb10c861f3eebb222cdd261957378b8a731c4c
Jun 03 00:59:55.224561 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:55.224534    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26bc4221-bde6-489e-aa25-2b64d7aca993" path="/var/lib/kubelet/pods/26bc4221-bde6-489e-aa25-2b64d7aca993/volumes"
Jun 03 00:59:55.717589 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:55.717550    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c3978df0-4568-4609-8c53-0edf5af784b4","Type":"ContainerStarted","Data":"3da771d00e2329405468989f64bea3c06e4aeecf5c42c8fdc7a8c99991b6291a"}
Jun 03 00:59:55.717589 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:55.717595    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c3978df0-4568-4609-8c53-0edf5af784b4","Type":"ContainerStarted","Data":"09e96067b7a2be631553454986bb10c861f3eebb222cdd261957378b8a731c4c"}
Jun 03 00:59:55.738501 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:55.738426    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.398192775 podStartE2EDuration="1.738406812s" podCreationTimestamp="2026-06-03 00:59:54 +0000 UTC" firstStartedPulling="2026-06-03 00:59:55.208415091 +0000 UTC m=+656.534924379" lastFinishedPulling="2026-06-03 00:59:55.548629132 +0000 UTC m=+656.875138416" observedRunningTime="2026-06-03 00:59:55.734514142 +0000 UTC m=+657.061023448" watchObservedRunningTime="2026-06-03 00:59:55.738406812 +0000 UTC m=+657.064916220"
Jun 03 00:59:56.073130 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:56.073093    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 00:59:56.074707 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:56.074674    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 00:59:57.073628 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:57.073572    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 00:59:58.073403 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:58.073350    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 00:59:59.072842 ip-10-0-141-62 kubenswrapper[2551]: I0603 00:59:59.072780    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:00.073497 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:00.073445    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:01.073032 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:01.072969    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:02.073761 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:02.073715    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:03.073150 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:03.073093    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:04.072704 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:04.072629    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:05.072557 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:05.072510    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:00:05.072934 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:05.072895    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:06.073126 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:06.073062    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:07.072869 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:07.072822    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:08.072925 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:08.072864    2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.48:9000/health/started\": dial tcp 10.133.0.48:9000: connect: connection refused"
Jun 03 01:00:09.165050 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:09.165000    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:00:09.181526 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:09.181472    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 01:00:19.170872 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:19.170817    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c3978df0-4568-4609-8c53-0edf5af784b4" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 01:00:29.171835 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:00:29.171796    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:01:15.650171 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.650130    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"]
Jun 03 01:01:15.654292 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.654265    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.658124 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.658097    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fp5s5\""
Jun 03 01:01:15.658265 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.658119    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 01:01:15.658265 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.658135    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 01:01:15.658408 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.658143    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 03 01:01:15.666070 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.666035    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"]
Jun 03 01:01:15.815836 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.815793    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2nj\" (UniqueName: \"kubernetes.io/projected/150c7ead-4796-4b51-bae0-38dae753ba4a-kube-api-access-bf2nj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.816008 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.815850    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.816008 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.815870    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.816008 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.815927    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150c7ead-4796-4b51-bae0-38dae753ba4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.816008 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.815957    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.816008 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.815985    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.916832 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.916734    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.916832 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.916774    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.916832 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.916814    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150c7ead-4796-4b51-bae0-38dae753ba4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.917094 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.916861    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.917094 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.916911    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.917094 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.916967    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2nj\" (UniqueName: \"kubernetes.io/projected/150c7ead-4796-4b51-bae0-38dae753ba4a-kube-api-access-bf2nj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.917260 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.917236    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.917298 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.917249    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.917363 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.917342    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.919248 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.919219    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150c7ead-4796-4b51-bae0-38dae753ba4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.919383 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.919365    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150c7ead-4796-4b51-bae0-38dae753ba4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.924455 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.924428    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2nj\" (UniqueName: \"kubernetes.io/projected/150c7ead-4796-4b51-bae0-38dae753ba4a-kube-api-access-bf2nj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk\" (UID: \"150c7ead-4796-4b51-bae0-38dae753ba4a\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:15.969481 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:15.969438    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:16.109474 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:16.109431    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"]
Jun 03 01:01:16.109718 ip-10-0-141-62 kubenswrapper[2551]: W0603 01:01:16.109687    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150c7ead_4796_4b51_bae0_38dae753ba4a.slice/crio-16130945ed13b855e0eaa81b47409091f11878cc3cecc8e0da0641771e489f0b WatchSource:0}: Error finding container 16130945ed13b855e0eaa81b47409091f11878cc3cecc8e0da0641771e489f0b: Status 404 returned error can't find the container with id 16130945ed13b855e0eaa81b47409091f11878cc3cecc8e0da0641771e489f0b
Jun 03 01:01:17.066469 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:17.066426    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk" event={"ID":"150c7ead-4796-4b51-bae0-38dae753ba4a","Type":"ContainerStarted","Data":"16130945ed13b855e0eaa81b47409091f11878cc3cecc8e0da0641771e489f0b"}
Jun 03 01:01:19.077278 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:19.077238    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk" event={"ID":"150c7ead-4796-4b51-bae0-38dae753ba4a","Type":"ContainerStarted","Data":"12e1778a4c39514fc6f63f5ac1ddbe791a3970cfbbbd26875f67f2e111d290f4"}
Jun 03 01:01:21.090418 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:21.090383    2551 generic.go:358] "Generic (PLEG): container finished" podID="150c7ead-4796-4b51-bae0-38dae753ba4a" containerID="12e1778a4c39514fc6f63f5ac1ddbe791a3970cfbbbd26875f67f2e111d290f4" exitCode=0
Jun 03 01:01:21.090833 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:21.090457    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk" event={"ID":"150c7ead-4796-4b51-bae0-38dae753ba4a","Type":"ContainerDied","Data":"12e1778a4c39514fc6f63f5ac1ddbe791a3970cfbbbd26875f67f2e111d290f4"}
Jun 03 01:01:24.105195 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:24.105158    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk" event={"ID":"150c7ead-4796-4b51-bae0-38dae753ba4a","Type":"ContainerStarted","Data":"d9ce2a69432a4c15fd6ba5cec454fc158ca30fe83a923f9bb22f9703ef9b9b10"}
Jun 03 01:01:24.125156 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:24.125099    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk" podStartSLOduration=1.328276897 podStartE2EDuration="9.125085062s" podCreationTimestamp="2026-06-03 01:01:15 +0000 UTC" firstStartedPulling="2026-06-03 01:01:16.111613318 +0000 UTC m=+737.438122602" lastFinishedPulling="2026-06-03 01:01:23.908421478 +0000 UTC m=+745.234930767" observedRunningTime="2026-06-03 01:01:24.123864799 +0000 UTC m=+745.450374106" watchObservedRunningTime="2026-06-03 01:01:24.125085062 +0000 UTC m=+745.451594370"
Jun 03 01:01:25.970272 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:25.970234    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:25.970778 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:25.970551    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:25.983219 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:25.983187    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:26.124731 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:26.124696    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk"
Jun 03 01:01:41.447162 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.447119    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"]
Jun 03 01:01:41.453794 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.453774    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.457362 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.457333    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 03 01:01:41.460448 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.460421    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"]
Jun 03 01:01:41.541963 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.541924    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.542139 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.541972    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.542139 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.542034    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6965\" (UniqueName: \"kubernetes.io/projected/06b56550-71d6-4e75-a927-f28bd3ef6119-kube-api-access-l6965\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.542139 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.542094    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06b56550-71d6-4e75-a927-f28bd3ef6119-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.542139 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.542128    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.542276 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.542174    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.642817 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.642778    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06b56550-71d6-4e75-a927-f28bd3ef6119-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643003 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.642824    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643003 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.642870    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643003 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.642905    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643124 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.643072    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643124 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.643117    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6965\" (UniqueName: \"kubernetes.io/projected/06b56550-71d6-4e75-a927-f28bd3ef6119-kube-api-access-l6965\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643403 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.643381    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643517 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.643446    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.643517 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.643497    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.645312 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.645284    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06b56550-71d6-4e75-a927-f28bd3ef6119-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.645511 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.645492    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06b56550-71d6-4e75-a927-f28bd3ef6119-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.651000 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.650968    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6965\" (UniqueName: \"kubernetes.io/projected/06b56550-71d6-4e75-a927-f28bd3ef6119-kube-api-access-l6965\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf\" (UID: \"06b56550-71d6-4e75-a927-f28bd3ef6119\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.766720 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.766600    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:41.903674 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:41.903628    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"]
Jun 03 01:01:41.904891 ip-10-0-141-62 kubenswrapper[2551]: W0603 01:01:41.904858    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b56550_71d6_4e75_a927_f28bd3ef6119.slice/crio-62791eeae0c01e2d79c08820b191bbd1e5b5b5c648503b8d2833aa852dc3d861 WatchSource:0}: Error finding container 62791eeae0c01e2d79c08820b191bbd1e5b5b5c648503b8d2833aa852dc3d861: Status 404 returned error can't find the container with id 62791eeae0c01e2d79c08820b191bbd1e5b5b5c648503b8d2833aa852dc3d861
Jun 03 01:01:42.177199 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:42.177155    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf" event={"ID":"06b56550-71d6-4e75-a927-f28bd3ef6119","Type":"ContainerStarted","Data":"e85b6018e05ec3f5b36263b6ce1d0cb4cf27589b7513aec8667021beab3494be"}
Jun 03 01:01:42.177199 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:42.177199    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf" event={"ID":"06b56550-71d6-4e75-a927-f28bd3ef6119","Type":"ContainerStarted","Data":"62791eeae0c01e2d79c08820b191bbd1e5b5b5c648503b8d2833aa852dc3d861"}
Jun 03 01:01:47.202121 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:47.202081    2551 generic.go:358] "Generic (PLEG): container finished" podID="06b56550-71d6-4e75-a927-f28bd3ef6119" containerID="e85b6018e05ec3f5b36263b6ce1d0cb4cf27589b7513aec8667021beab3494be" exitCode=0
Jun 03 01:01:47.202550 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:47.202158    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf" event={"ID":"06b56550-71d6-4e75-a927-f28bd3ef6119","Type":"ContainerDied","Data":"e85b6018e05ec3f5b36263b6ce1d0cb4cf27589b7513aec8667021beab3494be"}
Jun 03 01:01:48.208422 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:48.208389    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf" event={"ID":"06b56550-71d6-4e75-a927-f28bd3ef6119","Type":"ContainerStarted","Data":"6ac9f98aee2d826b54a7ecf83849acab84e25c4fad3ddb0cf8210d3a2a5bdbd6"}
Jun 03 01:01:48.229774 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:48.229718    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf" podStartSLOduration=7.005732363 podStartE2EDuration="7.229702567s" podCreationTimestamp="2026-06-03 01:01:41 +0000 UTC" firstStartedPulling="2026-06-03 01:01:47.202826088 +0000 UTC m=+768.529335375" lastFinishedPulling="2026-06-03 01:01:47.426796291 +0000 UTC m=+768.753305579" observedRunningTime="2026-06-03 01:01:48.22758176 +0000 UTC m=+769.554091067" watchObservedRunningTime="2026-06-03 01:01:48.229702567 +0000 UTC m=+769.556211873"
Jun 03 01:01:51.767593 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:51.767548    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:51.768025 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:51.767614    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:51.780178 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:51.780139    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:01:52.236524 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:01:52.236488    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf"
Jun 03 01:07:05.783284 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:05.783247    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6995685bb-4s57p_03f03f3b-a482-4fb9-9012-4e70a14fb953/nginx/0.log"
Jun 03 01:07:05.993900 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:05.993853    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-72xnr_5b59a125-3691-40ba-b5dd-b4f0571a4cd4/manager/0.log"
Jun 03 01:07:06.110389 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:06.110348    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-mqmvs_6ad89a31-5309-4e93-8faf-ab270d050138/manager/0.log"
Jun 03 01:07:06.222504 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:06.222471    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7c8889db44-ptkfm_b2d74377-41c7-408c-81ee-3c864ec5c455/maas-api/0.log"
Jun 03 01:07:06.561922 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:06.561839    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-ndlwf_ba674455-9e54-4f9c-90ce-8a742ed59979/server/0.log"
Jun 03 01:07:06.677795 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:06.677762    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-m9lk9_607b7446-0990-498a-b516-ac98c5d44853/manager/0.log"
Jun 03 01:07:06.788374 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:06.788343    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-4gjqq_c8e40d3e-8f23-4e0e-9031-8282627acea1/copy-manifests/0.log"
Jun 03 01:07:06.795311 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:06.795285    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-4gjqq_c8e40d3e-8f23-4e0e-9031-8282627acea1/manager/0.log"
Jun 03 01:07:07.889427 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:07.889389    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw_1df20887-830d-4ef4-846c-7e0ace5e2c37/util/0.log"
Jun 03 01:07:07.895722 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:07.895699    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw_1df20887-830d-4ef4-846c-7e0ace5e2c37/pull/0.log"
Jun 03 01:07:07.901731 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:07.901708    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw_1df20887-830d-4ef4-846c-7e0ace5e2c37/extract/0.log"
Jun 03 01:07:08.008540 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.008509    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t_290ca5c7-b781-4570-83c0-82ce525d5722/util/0.log"
Jun 03 01:07:08.014586 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.014477    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t_290ca5c7-b781-4570-83c0-82ce525d5722/pull/0.log"
Jun 03 01:07:08.020636 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.020614    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t_290ca5c7-b781-4570-83c0-82ce525d5722/extract/0.log"
Jun 03 01:07:08.128794 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.128766    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49_a023d55f-50b3-46ab-9d6d-7d041c71df61/util/0.log"
Jun 03 01:07:08.134703 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.134680    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49_a023d55f-50b3-46ab-9d6d-7d041c71df61/pull/0.log"
Jun 03 01:07:08.140214 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.140153    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49_a023d55f-50b3-46ab-9d6d-7d041c71df61/extract/0.log"
Jun 03 01:07:08.247964 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.247939    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7_74b31ea8-6264-4e04-92b2-673def33497c/util/0.log"
Jun 03 01:07:08.254109 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.254082    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7_74b31ea8-6264-4e04-92b2-673def33497c/pull/0.log"
Jun 03 01:07:08.259928 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.259909    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7_74b31ea8-6264-4e04-92b2-673def33497c/extract/0.log"
Jun 03 01:07:08.596220 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.596199    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ldkpz_789ba384-c2dc-46c6-aa5b-89884cacdefd/manager/0.log"
Jun 03 01:07:08.937183 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:08.937105    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-f8mrs_78100fc6-f87e-433e-9a44-d2f1bfc7bc86/manager/0.log"
Jun 03 01:07:09.166357 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:09.166321    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qtzhr_344b5470-514c-4292-b745-7554af2065ba/manager/0.log"
Jun 03 01:07:09.636448 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:09.636418    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-49j6k_90e1349b-d9bf-4fd2-8e0f-56cee0233906/discovery/0.log"
Jun 03 01:07:09.740823 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:09.740795    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df58ddb79-rm99k_789fac25-8285-4e18-ab72-2d7358668621/kube-auth-proxy/0.log"
Jun 03 01:07:10.772785 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:10.772755    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk_150c7ead-4796-4b51-bae0-38dae753ba4a/storage-initializer/0.log"
Jun 03 01:07:10.782030 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:10.782009    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-7l7gk_150c7ead-4796-4b51-bae0-38dae753ba4a/main/0.log"
Jun 03 01:07:11.153122 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:11.153097    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf_06b56550-71d6-4e75-a927-f28bd3ef6119/storage-initializer/0.log"
Jun 03 01:07:11.160109 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:11.160081    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-nlxcf_06b56550-71d6-4e75-a927-f28bd3ef6119/main/0.log"
Jun 03 01:07:18.079294 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:18.079263    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p9965_8a05a34f-dfa0-4d40-bbb5-76510b09ba0b/global-pull-secret-syncer/0.log"
Jun 03 01:07:18.131683 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:18.131627    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4gs9t_6ed7f138-3af8-4d0c-a009-55006ff67942/konnectivity-agent/0.log"
Jun 03 01:07:18.264652 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:18.264618    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-62.ec2.internal_cfe05e4f784b8c17aa7c181730d5d5b7/haproxy/0.log"
Jun 03 01:07:22.119327 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.119289    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw_1df20887-830d-4ef4-846c-7e0ace5e2c37/extract/0.log"
Jun 03 01:07:22.143649 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.143618    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw_1df20887-830d-4ef4-846c-7e0ace5e2c37/util/0.log"
Jun 03 01:07:22.170128 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.170085    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jvcsw_1df20887-830d-4ef4-846c-7e0ace5e2c37/pull/0.log"
Jun 03 01:07:22.197247 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.197217    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t_290ca5c7-b781-4570-83c0-82ce525d5722/extract/0.log"
Jun 03 01:07:22.225881 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.225845    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t_290ca5c7-b781-4570-83c0-82ce525d5722/util/0.log"
Jun 03 01:07:22.256573 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.256544    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vr2t_290ca5c7-b781-4570-83c0-82ce525d5722/pull/0.log"
Jun 03 01:07:22.284932 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.284899    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49_a023d55f-50b3-46ab-9d6d-7d041c71df61/extract/0.log"
Jun 03 01:07:22.306431 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.306405    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49_a023d55f-50b3-46ab-9d6d-7d041c71df61/util/0.log"
Jun 03 01:07:22.329920 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.329892    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ld49_a023d55f-50b3-46ab-9d6d-7d041c71df61/pull/0.log"
Jun 03 01:07:22.359929 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.359901    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7_74b31ea8-6264-4e04-92b2-673def33497c/extract/0.log"
Jun 03 01:07:22.380983 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.380896    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7_74b31ea8-6264-4e04-92b2-673def33497c/util/0.log"
Jun 03 01:07:22.408670 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.408631    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mxdn7_74b31ea8-6264-4e04-92b2-673def33497c/pull/0.log"
Jun 03 01:07:22.527380 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.527350    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ldkpz_789ba384-c2dc-46c6-aa5b-89884cacdefd/manager/0.log"
Jun 03 01:07:22.623982 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.623952    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-f8mrs_78100fc6-f87e-433e-9a44-d2f1bfc7bc86/manager/0.log"
Jun 03 01:07:22.683273 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:22.683179    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qtzhr_344b5470-514c-4292-b745-7554af2065ba/manager/0.log"
Jun 03 01:07:24.657032 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:24.657004    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66778f6cd5-jcw8n_8412f819-c058-46b9-96d3-1e6f57e4d6e2/metrics-server/0.log"
Jun 03 01:07:24.796436 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:24.796393    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h79cb_ef3d0d78-6dc0-4944-b5d5-10e0530141ba/node-exporter/0.log"
Jun 03 01:07:24.818254 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:24.818225    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h79cb_ef3d0d78-6dc0-4944-b5d5-10e0530141ba/kube-rbac-proxy/0.log"
Jun 03 01:07:24.846436 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:24.846412    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h79cb_ef3d0d78-6dc0-4944-b5d5-10e0530141ba/init-textfile/0.log"
Jun 03 01:07:25.014821 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:25.014743    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cdh25_e7747d9e-8399-46de-aaea-29dad01ec682/kube-rbac-proxy-main/0.log"
Jun 03 01:07:25.039820 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:25.039791    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cdh25_e7747d9e-8399-46de-aaea-29dad01ec682/kube-rbac-proxy-self/0.log"
Jun 03 01:07:25.061026 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:25.061002    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cdh25_e7747d9e-8399-46de-aaea-29dad01ec682/openshift-state-metrics/0.log"
Jun 03 01:07:25.247172 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:25.247141    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-m6cdk_fb7da751-ec11-450f-8b73-20fa697e7fcb/prometheus-operator/0.log"
Jun 03 01:07:25.268064 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:25.267989    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-m6cdk_fb7da751-ec11-450f-8b73-20fa697e7fcb/kube-rbac-proxy/0.log"
Jun 03 01:07:25.291460 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:25.291433    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-ljd9m_67dd8746-4fb5-4ae1-8aa2-1100557cf576/prometheus-operator-admission-webhook/0.log"
Jun 03 01:07:26.989692 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:26.989640    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"]
Jun 03 01:07:26.993251 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:26.993228    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:26.995817 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:26.995795    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wc94h\"/\"kube-root-ca.crt\""
Jun 03 01:07:26.997049 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:26.997023    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wc94h\"/\"openshift-service-ca.crt\""
Jun 03 01:07:26.997396 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:26.997372    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wc94h\"/\"default-dockercfg-xxpt9\""
Jun 03 01:07:27.000868 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.000846    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"]
Jun 03 01:07:27.121538 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.121500    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-proc\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.121538 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.121541    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8lnd\" (UniqueName: \"kubernetes.io/projected/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-kube-api-access-j8lnd\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.121833 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.121700    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-sys\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.121833 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.121776    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-lib-modules\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.121833 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.121799    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-podres\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.222911 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.222874    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-sys\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223099 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.222942    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-lib-modules\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223099 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.222965    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-podres\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223099 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.223000    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-sys\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223099 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.223017    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-proc\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223099 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.223069    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8lnd\" (UniqueName: \"kubernetes.io/projected/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-kube-api-access-j8lnd\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223315 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.223113    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-lib-modules\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223315 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.223074    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-proc\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.223315 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.223129    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-podres\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.230544 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.230523    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8lnd\" (UniqueName: \"kubernetes.io/projected/f9ccad24-bef2-48f0-9f84-90cfc4a2c15b-kube-api-access-j8lnd\") pod \"perf-node-gather-daemonset-xncmz\" (UID: \"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.304418 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.304330    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.442103 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.442078    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"]
Jun 03 01:07:27.443458 ip-10-0-141-62 kubenswrapper[2551]: W0603 01:07:27.443429    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf9ccad24_bef2_48f0_9f84_90cfc4a2c15b.slice/crio-2cfef555f08eb87777c9bca1a9493466ff24fe05381d634a841d46cc7e45cf95 WatchSource:0}: Error finding container 2cfef555f08eb87777c9bca1a9493466ff24fe05381d634a841d46cc7e45cf95: Status 404 returned error can't find the container with id 2cfef555f08eb87777c9bca1a9493466ff24fe05381d634a841d46cc7e45cf95
Jun 03 01:07:27.445127 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.445108    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 01:07:27.558722 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.558592    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz" event={"ID":"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b","Type":"ContainerStarted","Data":"2aa54a77e8fcd8a5adb6f2d7d297a13cd4454fa56faf774d6295535a63263b35"}
Jun 03 01:07:27.558722 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.558635    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz" event={"ID":"f9ccad24-bef2-48f0-9f84-90cfc4a2c15b","Type":"ContainerStarted","Data":"2cfef555f08eb87777c9bca1a9493466ff24fe05381d634a841d46cc7e45cf95"}
Jun 03 01:07:27.558722 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.558695    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:27.575433 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:27.575380    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz" podStartSLOduration=1.575366171 podStartE2EDuration="1.575366171s" podCreationTimestamp="2026-06-03 01:07:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:07:27.573362887 +0000 UTC m=+1108.899872193" watchObservedRunningTime="2026-06-03 01:07:27.575366171 +0000 UTC m=+1108.901875478"
Jun 03 01:07:28.956778 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:28.956750    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsdvq_f9e8e66d-90f4-4041-a2cb-183a80de56ba/dns/0.log"
Jun 03 01:07:28.976000 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:28.975967    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsdvq_f9e8e66d-90f4-4041-a2cb-183a80de56ba/kube-rbac-proxy/0.log"
Jun 03 01:07:29.039854 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:29.039822    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m9tb7_286f5172-7063-473f-93fd-a2a662469b48/dns-node-resolver/0.log"
Jun 03 01:07:29.525531 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:29.525496    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bc474588f-ktwjb_38d9145d-183f-4fa3-8686-9bfb4d329caf/registry/0.log"
Jun 03 01:07:29.598395 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:29.598363    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rpt6m_231d2c36-0c31-4915-8eef-57b32a58c80c/node-ca/0.log"
Jun 03 01:07:30.423845 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:30.423809    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-49j6k_90e1349b-d9bf-4fd2-8e0f-56cee0233906/discovery/0.log"
Jun 03 01:07:30.443391 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:30.443366    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df58ddb79-rm99k_789fac25-8285-4e18-ab72-2d7358668621/kube-auth-proxy/0.log"
Jun 03 01:07:31.088623 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:31.088595    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-srh86_6cc27237-ab9b-488d-bbaf-8872e280d33a/serve-healthcheck-canary/0.log"
Jun 03 01:07:31.520305 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:31.520274    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdn5p_6d633c5b-b1f6-4990-8ef1-7f0adb32121f/kube-rbac-proxy/0.log"
Jun 03 01:07:31.540120 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:31.540088    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdn5p_6d633c5b-b1f6-4990-8ef1-7f0adb32121f/exporter/0.log"
Jun 03 01:07:31.561039 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:31.561012    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdn5p_6d633c5b-b1f6-4990-8ef1-7f0adb32121f/extractor/0.log"
Jun 03 01:07:33.574602 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.574567    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-xncmz"
Jun 03 01:07:33.602891 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.602864    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6995685bb-4s57p_03f03f3b-a482-4fb9-9012-4e70a14fb953/nginx/0.log"
Jun 03 01:07:33.650011 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.649984    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-72xnr_5b59a125-3691-40ba-b5dd-b4f0571a4cd4/manager/0.log"
Jun 03 01:07:33.695472 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.695434    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-mqmvs_6ad89a31-5309-4e93-8faf-ab270d050138/manager/0.log"
Jun 03 01:07:33.718383 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.718349    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7c8889db44-ptkfm_b2d74377-41c7-408c-81ee-3c864ec5c455/maas-api/0.log"
Jun 03 01:07:33.785461 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.785427    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-ndlwf_ba674455-9e54-4f9c-90ce-8a742ed59979/server/0.log"
Jun 03 01:07:33.833201 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.833105    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-m9lk9_607b7446-0990-498a-b516-ac98c5d44853/manager/0.log"
Jun 03 01:07:33.855194 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.855162    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-4gjqq_c8e40d3e-8f23-4e0e-9031-8282627acea1/manager/0.log"
Jun 03 01:07:33.874882 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:33.874858    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-4gjqq_c8e40d3e-8f23-4e0e-9031-8282627acea1/copy-manifests/0.log"
Jun 03 01:07:35.399456 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:35.399415    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-z57bs_f0586c78-ed6c-4194-8134-af5d875e56d4/openshift-lws-operator/0.log"
Jun 03 01:07:39.985752 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:39.985714    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-5496m_0213dffa-d79f-4545-94e5-9932b0cdcd08/migrator/0.log"
Jun 03 01:07:40.006839 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:40.006806    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-5496m_0213dffa-d79f-4545-94e5-9932b0cdcd08/graceful-termination/0.log"
Jun 03 01:07:41.309685 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.309634    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2cgzj_2676174a-ae2c-4c9c-b960-1381fb094d19/kube-multus/0.log"
Jun 03 01:07:41.528050 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.528023    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rl4tw_ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a/kube-multus-additional-cni-plugins/0.log"
Jun 03 01:07:41.548851 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.548819    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rl4tw_ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a/egress-router-binary-copy/0.log"
Jun 03 01:07:41.568926 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.568845    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rl4tw_ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a/cni-plugins/0.log"
Jun 03 01:07:41.588256 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.588224    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rl4tw_ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a/bond-cni-plugin/0.log"
Jun 03 01:07:41.623273 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.623243    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rl4tw_ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a/routeoverride-cni/0.log"
Jun 03 01:07:41.672386 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.672358    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rl4tw_ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a/whereabouts-cni-bincopy/0.log"
Jun 03 01:07:41.715610 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.715574    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rl4tw_ef24eea1-d7c1-4fe1-b10b-b18b0c504a3a/whereabouts-cni/0.log"
Jun 03 01:07:41.928530 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.928501    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9b5w7_d7f27f4d-335b-47cb-b268-9df19c5d9951/network-metrics-daemon/0.log"
Jun 03 01:07:41.948047 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:41.948016    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9b5w7_d7f27f4d-335b-47cb-b268-9df19c5d9951/kube-rbac-proxy/0.log"
Jun 03 01:07:42.826044 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:42.825963    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/ovn-controller/0.log"
Jun 03 01:07:42.849488 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:42.849458    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/ovn-acl-logging/0.log"
Jun 03 01:07:42.872585 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:42.872557    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/kube-rbac-proxy-node/0.log"
Jun 03 01:07:42.892113 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:42.892088    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/kube-rbac-proxy-ovn-metrics/0.log"
Jun 03 01:07:42.911118 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:42.911091    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/northd/0.log"
Jun 03 01:07:42.933501 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:42.933478    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/nbdb/0.log"
Jun 03 01:07:42.953974 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:42.953951    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/sbdb/0.log"
Jun 03 01:07:43.046071 ip-10-0-141-62 kubenswrapper[2551]: I0603 01:07:43.046034    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmwgr_d3ede5a2-a50e-447b-8346-d6d09b0065bb/ovnkube-controller/0.log"