May 21 16:31:49.733747 ip-10-0-141-23 systemd[1]: Starting Kubernetes Kubelet...
May 21 16:31:50.105838 ip-10-0-141-23 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:31:50.105838 ip-10-0-141-23 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 16:31:50.105838 ip-10-0-141-23 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:31:50.105838 ip-10-0-141-23 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 16:31:50.105838 ip-10-0-141-23 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:31:50.106525 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.106390    2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 16:31:50.112714 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112525    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:31:50.112714 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112713    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:31:50.112714 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112718    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112723    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112727    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112730    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112733    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112739    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112743    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112747    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112750    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112753    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112757    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112760    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112763    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112766    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112769    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112772    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112774    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112777    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112781    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112783    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:31:50.112867 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112786    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112788    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112791    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112794    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112796    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112799    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112801    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112804    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112806    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112811    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112814    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112817    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112819    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112822    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112825    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112828    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112831    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112834    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112836    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112839    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:31:50.113345 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112842    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112844    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112847    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112851    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112856    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112859    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112863    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112866    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112869    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112872    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112875    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112878    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112881    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112884    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112886    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112889    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112891    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112894    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112897    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:31:50.113870 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112899    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112902    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112904    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112907    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112909    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112912    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112914    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112919    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112922    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112927    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112930    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112932    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112935    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112938    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112940    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112943    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112946    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112949    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112952    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112955    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:31:50.114332 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112957    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112960    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112963    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112965    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.112968    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113387    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113392    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113395    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113398    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113401    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113403    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113406    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113408    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113411    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113414    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113416    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113419    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113421    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113424    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113427    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:31:50.114829 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113430    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113432    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113435    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113438    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113440    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113443    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113446    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113448    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113451    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113469    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113472    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113475    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113477    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113480    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113484    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113486    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113489    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113494    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113497    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:31:50.115297 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113501    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113504    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113507    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113510    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113512    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113515    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113517    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113520    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113523    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113525    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113528    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113530    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113533    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113536    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113538    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113541    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113544    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113546    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113549    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113551    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:31:50.115790 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113554    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113558    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113561    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113564    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113567    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113570    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113572    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113575    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113577    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113580    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113582    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113585    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113589    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113591    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113594    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113596    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113599    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113601    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113604    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:31:50.116313 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113606    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113609    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113612    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113615    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113618    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113620    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113623    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113625    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113628    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113630    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113633    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113635    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.113638    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114823    2567 flags.go:64] FLAG: --address="0.0.0.0"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114832    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114840    2567 flags.go:64] FLAG: --anonymous-auth="true"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114845    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114851    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114855    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114859    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114863    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 16:31:50.116791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114866    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114869    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114873    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114876    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114879    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114882    2567 flags.go:64] FLAG: --cgroup-root=""
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114885    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114888    2567 flags.go:64] FLAG: --client-ca-file=""
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114891    2567 flags.go:64] FLAG: --cloud-config=""
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114894    2567 flags.go:64] FLAG: --cloud-provider="external"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114896    2567 flags.go:64] FLAG: --cluster-dns="[]"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114902    2567 flags.go:64] FLAG: --cluster-domain=""
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114904    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114908    2567 flags.go:64] FLAG: --config-dir=""
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114911    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114914    2567 flags.go:64] FLAG: --container-log-max-files="5"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114918    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114921    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114924    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114927    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114930    2567 flags.go:64] FLAG: --contention-profiling="false"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114933    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114936    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114939    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114942    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 16:31:50.117294 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114946    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114949    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114952    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114955    2567 flags.go:64] FLAG: --enable-load-reader="false"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114959    2567 flags.go:64] FLAG: --enable-server="true"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114962    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114966    2567 flags.go:64] FLAG: --event-burst="100"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114969    2567 flags.go:64] FLAG: --event-qps="50"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114972    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114975    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114978    2567 flags.go:64] FLAG: --eviction-hard=""
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114981    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114984    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114987    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114990    2567 flags.go:64] FLAG: --eviction-soft=""
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114992    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114995    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.114998    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115001    2567 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115004    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115007    2567 flags.go:64] FLAG: --fail-swap-on="true"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115010    2567 flags.go:64] FLAG: --feature-gates=""
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115014    2567 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115017    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115020    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 16:31:50.117903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115023    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115026    2567 flags.go:64] FLAG: --healthz-port="10248"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115029    2567 flags.go:64] FLAG: --help="false"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115032    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-141-23.ec2.internal"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115035    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115038    2567 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115041    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115045    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115049    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115052    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115055    2567 flags.go:64] FLAG: --image-service-endpoint=""
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115057    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115061    2567 flags.go:64] FLAG: --kube-api-burst="100"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115064    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115067    2567 flags.go:64] FLAG: --kube-api-qps="50"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115070    2567 flags.go:64] FLAG: --kube-reserved=""
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115073    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115075    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115078    2567 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115081    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115084    2567 flags.go:64] FLAG: --lock-file=""
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115087    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115090    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115092    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 16:31:50.118629 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115105    2567 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115107    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115110    2567 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115113    2567 flags.go:64] FLAG: --logging-format="text"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115116    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115120    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115122    2567 flags.go:64] FLAG: --manifest-url=""
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115125    2567 flags.go:64] FLAG: --manifest-url-header=""
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115130    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115132    2567 flags.go:64] FLAG: --max-open-files="1000000"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115136    2567 flags.go:64] FLAG: --max-pods="110"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115140    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115143    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115146    2567 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115149    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115151    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115154    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115158    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115165    2567 flags.go:64] FLAG: --node-status-max-images="50"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115167    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115170    2567 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115174    2567 flags.go:64] FLAG: --pod-cidr=""
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115177    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 16:31:50.119194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115182    2567 flags.go:64] FLAG: --pod-manifest-path=""
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115185    2567 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115188    2567 flags.go:64] FLAG: --pods-per-core="0"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115191    2567 flags.go:64] FLAG: --port="10250"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115194    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115197    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07cd6cb3a9f66273a"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115200    2567 flags.go:64] FLAG: --qos-reserved=""
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115202    2567 flags.go:64] FLAG: --read-only-port="10255"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115205    2567 flags.go:64] FLAG: --register-node="true"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115208    2567 flags.go:64] FLAG: --register-schedulable="true"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115211    2567 flags.go:64] FLAG: --register-with-taints=""
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115215    2567 flags.go:64] FLAG: --registry-burst="10"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115218    2567 flags.go:64] FLAG: --registry-qps="5"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115220    2567 flags.go:64] FLAG: --reserved-cpus=""
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115223    2567 flags.go:64] FLAG: --reserved-memory=""
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115227    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115230    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115233    2567 flags.go:64] FLAG: --rotate-certificates="false"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115236    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115239    2567 flags.go:64] FLAG: --runonce="false"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115242    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115245    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115248    2567 flags.go:64] FLAG: --seccomp-default="false"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115250    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115253    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115256    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 16:31:50.119765 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115260    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115263    2567 flags.go:64] FLAG: --storage-driver-password="root"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115265    2567 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115268    2567 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115271    2567 flags.go:64] FLAG: --storage-driver-user="root"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115274    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115277    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115280    2567 flags.go:64] FLAG: --system-cgroups=""
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115283    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115288    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115291    2567 flags.go:64] FLAG: --tls-cert-file=""
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115294    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115299    2567 flags.go:64] FLAG: --tls-min-version=""
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115302    2567 flags.go:64] FLAG: --tls-private-key-file=""
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115304    2567 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115308    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115310    2567 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115313    2567 flags.go:64] FLAG: --v="2"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115318    2567 flags.go:64] FLAG: --version="false"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115322    2567 flags.go:64] FLAG: --vmodule=""
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115328    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.115331    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115428    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115432    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:31:50.120374 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115436    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115439    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115442    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115445    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115448    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115451    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115467    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115471    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115476    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115479    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115482    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115485    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115488    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115492    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115497    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115500    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115503    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115506    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115508    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:31:50.120959 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115512    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115516    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115519    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115522    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115525    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115528    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115531    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115534    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115537    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115542    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115545    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115548    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115550    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115553    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115555    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115558    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115560    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115563    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115565    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:31:50.121481 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115568    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115571    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115575    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115577    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115580    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115583    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115586    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115588    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115591    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115615    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115618    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115621    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115624    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115627    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115630    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115634    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115636    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115639    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115641    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115644    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:31:50.121944 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115646    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115649    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115653    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115655    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115658    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115660    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115663    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115665    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115668    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115671    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115673    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115676    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115678    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115681    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115685    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115688    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115691    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115693    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115696    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115698    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:31:50.122445 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115701    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115703    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115706    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115709    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115711    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.115714    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.116328    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.122671    2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.122786    2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122838    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122843    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122846    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122849    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122853    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122856    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122858    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:31:50.122967 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122862    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122865    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122868    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122872    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122876    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122879    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122882    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122886    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122888    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122891    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122894    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122897    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122900    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122903    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122905    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122908    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122911    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122913    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122917    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122920    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:31:50.123379 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122922    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122925    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122928    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122930    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122934    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122937    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122939    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122942    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122945    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122947    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122950    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122952    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122955    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122958    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122960    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122963    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122965    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122968    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122971    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122973    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:31:50.123887 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122976    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122979    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122982    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122984    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122986    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122989    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122992    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122995    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.122997    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123000    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123003    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123006    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123009    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123011    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123014    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123017    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123020    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123023    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123026    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123028    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:31:50.124372 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123031    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123034    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123036    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123038    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123041    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123044    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123046    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123049    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123051    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123054    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123057    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123059    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123062    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123064    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123066    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123069    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123071    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123075    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:31:50.124883 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123078    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.123083    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123183    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123187    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123190    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123193    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123196    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123200    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123203    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123205    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123210    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123213    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123217    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123220    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123223    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:31:50.125363 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123226    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123229    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123232    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123234    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123237    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123239    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123242    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123245    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123247    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123250    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123252    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123255    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123257    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123260    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123263    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123265    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123268    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123271    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123273    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123276    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:31:50.125749 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123278    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123281    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123283    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123286    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123289    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123292    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123295    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123297    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123300    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123303    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123305    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123308    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123310    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123313    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123315    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123318    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123320    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123323    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123326    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123328    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:31:50.126240 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123330    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123333    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123336    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123338    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123341    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123343    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123346    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123349    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123351    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123354    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123356    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123358    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123361    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123363    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123366    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123368    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123371    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123375    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123377    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:31:50.126758 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123379    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123382    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123385    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123387    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123390    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123393    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123395    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123398    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123401    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123404    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123407    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123410    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123413    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:50.123416    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.123421    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:31:50.127224 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.124182    2567 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 16:31:50.127687 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.126374    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 16:31:50.127687 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.127315    2567 server.go:1019] "Starting client certificate rotation"
May 21 16:31:50.127687 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.127437    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 16:31:50.127687 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.127497    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 16:31:50.149685 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.149664    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 16:31:50.154052 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.154029    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 16:31:50.168369 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.168348    2567 log.go:25] "Validated CRI v1 runtime API"
May 21 16:31:50.173725 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.173676    2567 log.go:25] "Validated CRI v1 image API"
May 21 16:31:50.175478 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.175449    2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 16:31:50.181070 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.181047    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8adddb47-3ec2-4cbd-abe2-f93c3cd26140:/dev/nvme0n1p4 af5dfdb2-377d-49ce-a7ca-568849c680a6:/dev/nvme0n1p3]
May 21 16:31:50.181135 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.181070    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 16:31:50.185931 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.185518    2567 manager.go:217] Machine: {Timestamp:2026-05-21 16:31:50.184973893 +0000 UTC m=+0.348706519 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100927 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b25943e84640a75140441af056542 SystemUUID:ec2b2594-3e84-640a-7514-0441af056542 BootID:05cf0e97-81fd-4ff0-b98a-f731b8594766 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:d3:08:a4:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:d3:08:a4:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:93:44:e6:e2:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 16:31:50.186587 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.186574    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 16:31:50.186681 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.186668    2567 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 16:31:50.188293 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.188273    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 16:31:50.188439 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.188412    2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 16:31:50.188624 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.188469    2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 16:31:50.188710 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.188640    2567 topology_manager.go:138] "Creating topology manager with none policy"
May 21 16:31:50.188710 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.188653    2567 container_manager_linux.go:306] "Creating device plugin manager"
May 21 16:31:50.188710 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.188664    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 16:31:50.189934 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.189921    2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 16:31:50.191364 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.191351    2567 state_mem.go:36] "Initialized new in-memory state store"
May 21 16:31:50.191520 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.191508    2567 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 16:31:50.194653 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.194640    2567 kubelet.go:491] "Attempting to sync node with API server"
May 21 16:31:50.194718 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.194670    2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 16:31:50.194718 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.194693    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 16:31:50.194718 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.194707    2567 kubelet.go:397] "Adding apiserver pod source"
May 21 16:31:50.194849 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.194719    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 16:31:50.195948 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.195934    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 16:31:50.196016 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.195957    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 16:31:50.199150 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.199130    2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 16:31:50.201371 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.201357    2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 16:31:50.202321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202307    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 16:31:50.202321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202324    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202331    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202337    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202346    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202352    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202358    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202364    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202371    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202377    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 16:31:50.202423 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202386    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 16:31:50.202705 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.202569    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 16:31:50.204059 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.204006    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 16:31:50.204121 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.204030    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 16:31:50.204121 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.204092    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 16:31:50.204205 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.204026    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 16:31:50.207571 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.207557    2567 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 16:31:50.207637 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.207595    2567 server.go:1295] "Started kubelet"
May 21 16:31:50.207702 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.207635    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 16:31:50.207751 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.207673    2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 16:31:50.207751 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.207735    2567 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 16:31:50.208540 ip-10-0-141-23 systemd[1]: Started Kubernetes Kubelet.
May 21 16:31:50.209110 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.208906    2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 16:31:50.210079 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.210066    2567 server.go:317] "Adding debug handlers to kubelet server"
May 21 16:31:50.212735 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.212717    2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 16:31:50.213769 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.212982    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-23.ec2.internal.18b1a1b131f65f8c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-23.ec2.internal,UID:ip-10-0-141-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-23.ec2.internal,},FirstTimestamp:2026-05-21 16:31:50.207569804 +0000 UTC m=+0.371302430,LastTimestamp:2026-05-21 16:31:50.207569804 +0000 UTC m=+0.371302430,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-23.ec2.internal,}"
May 21 16:31:50.215280 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.215261    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mqplx"
May 21 16:31:50.215649 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.215633    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 16:31:50.215649 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.215643    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 16:31:50.215761 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.215691    2567 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 16:31:50.215761 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.215700    2567 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 16:31:50.215850 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.215798    2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 16:31:50.218082 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218064    2567 reconstruct.go:97] "Volume reconstruction finished"
May 21 16:31:50.218082 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218082    2567 reconciler.go:26] "Reconciler: start to sync state"
May 21 16:31:50.218229 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.218105    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.218428 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218412    2567 factory.go:55] Registering systemd factory
May 21 16:31:50.218561 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218550    2567 factory.go:223] Registration of the systemd container factory successfully
May 21 16:31:50.218677 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.218545    2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 16:31:50.218896 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218878    2567 factory.go:153] Registering CRI-O factory
May 21 16:31:50.218953 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218903    2567 factory.go:223] Registration of the crio container factory successfully
May 21 16:31:50.219007 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218955    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 16:31:50.219007 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218975    2567 factory.go:103] Registering Raw factory
May 21 16:31:50.219007 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.218991    2567 manager.go:1196] Started watching for new ooms in manager
May 21 16:31:50.219624 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.219608    2567 manager.go:319] Starting recovery of all containers
May 21 16:31:50.224104 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.224080    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mqplx"
May 21 16:31:50.224274 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.224247    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 16:31:50.224407 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.224300    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 16:31:50.231047 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.231023    2567 manager.go:324] Recovery completed
May 21 16:31:50.235140 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.235128    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:31:50.236905 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.236889    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:31:50.236963 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.236920    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:31:50.236963 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.236931    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
May 21 16:31:50.237440 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.237427    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 16:31:50.237440 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.237440    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 16:31:50.237543 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.237503    2567 state_mem.go:36] "Initialized new in-memory state store"
May 21 16:31:50.239891 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.239879    2567 policy_none.go:49] "None policy: Start"
May 21 16:31:50.239935 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.239895    2567 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 16:31:50.239935 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.239905    2567 state_mem.go:35] "Initializing new in-memory state store"
May 21 16:31:50.278059 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.278042    2567 manager.go:341] "Starting Device Plugin manager"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.278096    2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.278112    2567 server.go:85] "Starting device plugin registration server"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.278380    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.278390    2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.278490    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.278559    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.278589    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.279508    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 16:31:50.284387 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.279565    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.314274 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.314240    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 16:31:50.315355 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.315340    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 16:31:50.315432 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.315369    2567 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 16:31:50.315432 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.315389    2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 16:31:50.315432 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.315405    2567 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 16:31:50.315582 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.315507    2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 16:31:50.321522 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.321503    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:31:50.379535 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.379480    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:31:50.380312 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.380296    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:31:50.380373 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.380327    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:31:50.380373 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.380336    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
May 21 16:31:50.380373 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.380360    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-23.ec2.internal"
May 21 16:31:50.387822 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.387804    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-23.ec2.internal"
May 21 16:31:50.387873 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.387825    2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-23.ec2.internal\": node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.409827 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.409809    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.416055 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.416029    2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"]
May 21 16:31:50.416142 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.416092    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:31:50.417743 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.417730    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:31:50.417743 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.417754    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:31:50.417848 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.417763    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
May 21 16:31:50.418828 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.418817    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:31:50.418963 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.418950    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.419002 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.418983    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:31:50.420767 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.420741    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:31:50.420842 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.420783    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:31:50.420842 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.420794    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
May 21 16:31:50.420842 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.420741    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:31:50.420933 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.420846    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:31:50.420933 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.420857    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
May 21 16:31:50.421764 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.421749    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.421817 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.421779    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:31:50.422482 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.422452    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:31:50.422535 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.422499    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:31:50.422535 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.422515    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
May 21 16:31:50.445997 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.445977    2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-23.ec2.internal\" not found" node="ip-10-0-141-23.ec2.internal"
May 21 16:31:50.450281 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.450267    2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-23.ec2.internal\" not found" node="ip-10-0-141-23.ec2.internal"
May 21 16:31:50.510135 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.510106    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.519321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.519303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a545e22638b0cd0a34514d2cd76ed0e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"a545e22638b0cd0a34514d2cd76ed0e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.519420 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.519337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a545e22638b0cd0a34514d2cd76ed0e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"a545e22638b0cd0a34514d2cd76ed0e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.519420 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.519363    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/218c7e0110a630061b5b90203b83e66e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-23.ec2.internal\" (UID: \"218c7e0110a630061b5b90203b83e66e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.610891 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.610861    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.620361 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.620339    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a545e22638b0cd0a34514d2cd76ed0e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"a545e22638b0cd0a34514d2cd76ed0e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.620422 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.620378    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a545e22638b0cd0a34514d2cd76ed0e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"a545e22638b0cd0a34514d2cd76ed0e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.620422 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.620403    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a545e22638b0cd0a34514d2cd76ed0e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"a545e22638b0cd0a34514d2cd76ed0e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.620422 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.620410    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/218c7e0110a630061b5b90203b83e66e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-23.ec2.internal\" (UID: \"218c7e0110a630061b5b90203b83e66e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.620545 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.620434    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a545e22638b0cd0a34514d2cd76ed0e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"a545e22638b0cd0a34514d2cd76ed0e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.620545 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.620473    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/218c7e0110a630061b5b90203b83e66e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-23.ec2.internal\" (UID: \"218c7e0110a630061b5b90203b83e66e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.711809 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.711740    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.748334 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.748307    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.753101 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:50.753081    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
May 21 16:31:50.812666 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.812636    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:50.913170 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:50.913140    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.013818 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:51.013745    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.114482 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:51.114440    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.127998 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.127978    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 16:31:51.128116 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.128101    2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 16:31:51.215421 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:51.215273    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.216370 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.216353    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 16:31:51.225952 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.225922    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 16:26:50 +0000 UTC" deadline="2027-12-18 00:14:22.024115316 +0000 UTC"
May 21 16:31:51.225952 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.225949    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13807h42m30.798169295s"
May 21 16:31:51.235523 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.235502    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 16:31:51.237534 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:51.237509    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218c7e0110a630061b5b90203b83e66e.slice/crio-8142182f02829e2c64dbfd648482df8afe8ad074f13c4937bebe242a4fe499eb WatchSource:0}: Error finding container 8142182f02829e2c64dbfd648482df8afe8ad074f13c4937bebe242a4fe499eb: Status 404 returned error can't find the container with id 8142182f02829e2c64dbfd648482df8afe8ad074f13c4937bebe242a4fe499eb
May 21 16:31:51.238755 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:51.238736    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda545e22638b0cd0a34514d2cd76ed0e2.slice/crio-d7e16adbaa6187b4d19f84551ba502c06e7aeb501895ffc05121418ff4742620 WatchSource:0}: Error finding container d7e16adbaa6187b4d19f84551ba502c06e7aeb501895ffc05121418ff4742620: Status 404 returned error can't find the container with id d7e16adbaa6187b4d19f84551ba502c06e7aeb501895ffc05121418ff4742620
May 21 16:31:51.241376 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.241361    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:31:51.264772 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.264727    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-545lh"
May 21 16:31:51.272768 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.272754    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-545lh"
May 21 16:31:51.315604 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:51.315579    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.317287 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.317270    2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:31:51.318495 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.318435    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" event={"ID":"a545e22638b0cd0a34514d2cd76ed0e2","Type":"ContainerStarted","Data":"d7e16adbaa6187b4d19f84551ba502c06e7aeb501895ffc05121418ff4742620"}
May 21 16:31:51.319318 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.319300    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal" event={"ID":"218c7e0110a630061b5b90203b83e66e","Type":"ContainerStarted","Data":"8142182f02829e2c64dbfd648482df8afe8ad074f13c4937bebe242a4fe499eb"}
May 21 16:31:51.416696 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:51.416657    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.517196 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:51.517126    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.617640 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:51.617608    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
May 21 16:31:51.675322 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.675293    2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:31:51.718561 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.718527    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
May 21 16:31:51.728913 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.728881    2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:31:51.729684 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.729661    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 16:31:51.730635 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.730597    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
May 21 16:31:51.738592 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:51.738573    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 16:31:52.195914 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.195881    2567 apiserver.go:52] "Watching apiserver"
May 21 16:31:52.203000 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.202967    2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 16:31:52.204828 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.204797    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-kc2cf","openshift-network-diagnostics/network-check-target-jjlbt","kube-system/konnectivity-agent-m4jzh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd","openshift-cluster-node-tuning-operator/tuned-rlpkd","openshift-network-operator/iptables-alerter-s5lgl","openshift-ovn-kubernetes/ovnkube-node-m87sz","kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal","openshift-dns/node-resolver-sncdc","openshift-image-registry/node-ca-lrsgr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal","openshift-multus/multus-additional-cni-plugins-ppxx2","openshift-multus/multus-xxhgn"]
May 21 16:31:52.206302 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.206276    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.207250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.207231    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:52.207400 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.207294    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:31:52.208316 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.208296    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.208918 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.208890    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 16:31:52.209084 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.208919    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 16:31:52.209084 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.208970    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 16:31:52.209284 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.209269    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 16:31:52.209284 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.209277    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 16:31:52.209415 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.209305    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 16:31:52.209490 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.209476    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-89jxh\""
May 21 16:31:52.209669 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.209650    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.210860 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.210838    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 16:31:52.211229 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.211212    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 16:31:52.211954 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.211895    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v9qk8\""
May 21 16:31:52.211954 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.211938    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-92flp\""
May 21 16:31:52.212182 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.212149    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 16:31:52.213523 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.213042    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 16:31:52.213523 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.213206    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.213785 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.213768    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 16:31:52.215408 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.215387    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 16:31:52.215408 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.215401    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gbm4r\""
May 21 16:31:52.215571 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.215399    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 16:31:52.215713 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.215692    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.216819 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.216803    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:52.216928 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.216887    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:31:52.216928 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.216907    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.217948 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.217933    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.218084 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.218064    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 16:31:52.218163 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.218124    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z7482\""
May 21 16:31:52.218218 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.218157    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 16:31:52.218405 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.218389    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 16:31:52.218937 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.218917    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 16:31:52.219079 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.218920    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 16:31:52.219202 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.218920    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4j2ht\""
May 21 16:31:52.219859 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.219833    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 16:31:52.220265 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.220243    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 16:31:52.220351 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.220251    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jmzqx\""
May 21 16:31:52.220408 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.220392    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 16:31:52.220516 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.220497    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.220579 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.220515    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.222651 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222452    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 16:31:52.222651 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222480    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 16:31:52.222651 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222589    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rlx6f\""
May 21 16:31:52.222863 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222689    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 16:31:52.222863 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222739    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bj5g\""
May 21 16:31:52.222863 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222784    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 16:31:52.222863 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222848    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 16:31:52.223014 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.222899    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 16:31:52.229751 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-run\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.229900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-lib-modules\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.229900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229785    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c928a47-ae3e-4ee9-9864-4bb35caea67d-host-slash\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.229900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqbp\" (UniqueName: \"kubernetes.io/projected/5c928a47-ae3e-4ee9-9864-4bb35caea67d-kube-api-access-8kqbp\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.229900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77db0607-0f8c-4c1f-906c-7824dd957b28-hosts-file\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.229900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229859    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59972\" (UniqueName: \"kubernetes.io/projected/e31daca4-2f26-47e6-a92b-0b7c00728d90-kube-api-access-59972\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.229900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-kubelet\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229904    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-node-log\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysctl-conf\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76ceee66-b909-4d8c-afcb-e37cbb76ca87-tmp\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229971    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77db0607-0f8c-4c1f-906c-7824dd957b28-tmp-dir\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.229992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trj55\" (UniqueName: \"kubernetes.io/projected/77db0607-0f8c-4c1f-906c-7824dd957b28-kube-api-access-trj55\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230038    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-socket-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-systemd\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230189 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230164    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-run-ovn-kubernetes\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-modprobe-d\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-device-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230307    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovnkube-script-lib\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysctl-d\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230357    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-var-lib-kubelet\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-tuned\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-cni-bin\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230441    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-cni-netd\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/050c91f4-c50a-423a-8e94-f12a0076a702-agent-certs\") pod \"konnectivity-agent-m4jzh\" (UID: \"050c91f4-c50a-423a-8e94-f12a0076a702\") " pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c928a47-ae3e-4ee9-9864-4bb35caea67d-iptables-alerter-script\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.230590 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-registration-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfrw4\" (UniqueName: \"kubernetes.io/projected/02c46b8c-6c40-47ce-8dc3-a46c30350906-kube-api-access-dfrw4\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230638    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-slash\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230654    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z5wv\" (UniqueName: \"kubernetes.io/projected/b8203791-5fa6-4800-90b6-ce0dce517ecb-kube-api-access-7z5wv\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230732    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysconfig\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230760    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-kubernetes\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230783    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-sys\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-sys-fs\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230856    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230889    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-run-netns\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230922    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovnkube-config\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovn-node-metrics-cert\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.230984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/050c91f4-c50a-423a-8e94-f12a0076a702-konnectivity-ca\") pod \"konnectivity-agent-m4jzh\" (UID: \"050c91f4-c50a-423a-8e94-f12a0076a702\") " pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231006    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-host\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxcrh\" (UniqueName: \"kubernetes.io/projected/76ceee66-b909-4d8c-afcb-e37cbb76ca87-kube-api-access-kxcrh\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.231239 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-systemd-units\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231078    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-var-lib-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231101    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-etc-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231133    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-ovn\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-log-socket\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-env-overrides\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.231898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.231228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-systemd\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.273357 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.273324    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:26:51 +0000 UTC" deadline="2027-11-09 13:05:34.760344793 +0000 UTC"
May 21 16:31:52.273357 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.273354    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12884h33m42.486994204s"
May 21 16:31:52.316923 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.316887    2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 16:31:52.331819 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.331786    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.331984 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.331828    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-log-socket\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.331984 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.331854    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-systemd\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.331984 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.331922    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-systemd\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.331984 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.331922    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-log-socket\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.331984 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.331970    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-run\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.331988    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332001    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c928a47-ae3e-4ee9-9864-4bb35caea67d-host-slash\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-756r5\" (UniqueName: \"kubernetes.io/projected/b58aa08a-5399-4e2d-a44c-428be7f298da-kube-api-access-756r5\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332040    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-run\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-system-cni-dir\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-hostroot\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332117    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c928a47-ae3e-4ee9-9864-4bb35caea67d-host-slash\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332136    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-node-log\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332169    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysctl-conf\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332188    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-node-log\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332194    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77db0607-0f8c-4c1f-906c-7824dd957b28-tmp-dir\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.332250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-os-release\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332282    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-systemd\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332290    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysctl-conf\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332310    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-run-ovn-kubernetes\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332316    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-systemd\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332337    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-modprobe-d\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-cnibin\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332375    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-run-ovn-kubernetes\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-daemon-config\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-host\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-serviceca\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9nzh\" (UniqueName: \"kubernetes.io/projected/76377b5f-4ec3-427a-9392-81c53727f5c8-kube-api-access-p9nzh\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332509    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-device-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332515    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-modprobe-d\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332534    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332543    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77db0607-0f8c-4c1f-906c-7824dd957b28-tmp-dir\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332572    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-tuned\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.332839 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332582    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332596    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-device-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b58aa08a-5399-4e2d-a44c-428be7f298da-cni-binary-copy\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332648    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dfrw4\" (UniqueName: \"kubernetes.io/projected/02c46b8c-6c40-47ce-8dc3-a46c30350906-kube-api-access-dfrw4\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332675    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-slash\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332700    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z5wv\" (UniqueName: \"kubernetes.io/projected/b8203791-5fa6-4800-90b6-ce0dce517ecb-kube-api-access-7z5wv\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332723    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-kubernetes\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332746    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-sys\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332762    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-slash\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332772    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqbp\" (UniqueName: \"kubernetes.io/projected/5c928a47-ae3e-4ee9-9864-4bb35caea67d-kube-api-access-8kqbp\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-os-release\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332817    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-kubernetes\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332848    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-sys\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-cni-multus\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332917    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.332972    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-sys-fs\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333001    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-run-netns\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333027    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovnkube-config\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.333616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333043    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-sys-fs\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333052    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-host\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333083    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-run-netns\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333097    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-host\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-conf-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333164    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-cnibin\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333214    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333249    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-systemd-units\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333275    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-var-lib-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333300    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-etc-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333326    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-ovn\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333346    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-env-overrides\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333404    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-kubelet\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-etc-kubernetes\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333468    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-lib-modules\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-netns\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333527    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59972\" (UniqueName: \"kubernetes.io/projected/e31daca4-2f26-47e6-a92b-0b7c00728d90-kube-api-access-59972\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.334503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333539    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-run-ovn\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333553    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-kubelet\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333544    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-var-lib-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333576    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-systemd-units\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333578    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76ceee66-b909-4d8c-afcb-e37cbb76ca87-tmp\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333600    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-etc-openvswitch\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333626    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trj55\" (UniqueName: \"kubernetes.io/projected/77db0607-0f8c-4c1f-906c-7824dd957b28-kube-api-access-trj55\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333654    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-system-cni-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333665    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovnkube-config\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333710    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-lib-modules\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333716    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-socket-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333743    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333770    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovnkube-script-lib\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333796    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysctl-d\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333819    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-var-lib-kubelet\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333840    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c928a47-ae3e-4ee9-9864-4bb35caea67d-iptables-alerter-script\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.335262 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-cni-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333884    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-cni-bin\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333932    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-cni-netd\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333937    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.333986    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334021    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/050c91f4-c50a-423a-8e94-f12a0076a702-agent-certs\") pod \"konnectivity-agent-m4jzh\" (UID: \"050c91f4-c50a-423a-8e94-f12a0076a702\") " pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334050    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-socket-dir-parent\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-k8s-cni-cncf-io\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-cni-bin\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334114    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-env-overrides\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334143    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-registration-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334172    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334221    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-cni-bin\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334245    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-registration-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334299    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysctl-d\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334289    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-var-lib-kubelet\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334388    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-kubelet\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334409    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e31daca4-2f26-47e6-a92b-0b7c00728d90-socket-dir\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334444    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysconfig\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334495    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovnkube-script-lib\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334502    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxcrh\" (UniqueName: \"kubernetes.io/projected/76ceee66-b909-4d8c-afcb-e37cbb76ca87-kube-api-access-kxcrh\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334539    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-sysconfig\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334536    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334571    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8203791-5fa6-4800-90b6-ce0dce517ecb-host-cni-netd\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334584    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77db0607-0f8c-4c1f-906c-7824dd957b28-hosts-file\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-multus-certs\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334626    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77db0607-0f8c-4c1f-906c-7824dd957b28-hosts-file\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334681    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334724    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovn-node-metrics-cert\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.334802    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334834    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/050c91f4-c50a-423a-8e94-f12a0076a702-konnectivity-ca\") pod \"konnectivity-agent-m4jzh\" (UID: \"050c91f4-c50a-423a-8e94-f12a0076a702\") " pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.334907    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:31:52.834860268 +0000 UTC m=+2.998592892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzhsh\" (UniqueName: \"kubernetes.io/projected/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-kube-api-access-hzhsh\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.336856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.334936    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c928a47-ae3e-4ee9-9864-4bb35caea67d-iptables-alerter-script\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.337630 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.335362    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/050c91f4-c50a-423a-8e94-f12a0076a702-konnectivity-ca\") pod \"konnectivity-agent-m4jzh\" (UID: \"050c91f4-c50a-423a-8e94-f12a0076a702\") " pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.337630 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.337587    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76ceee66-b909-4d8c-afcb-e37cbb76ca87-tmp\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.337726 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.337688    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76ceee66-b909-4d8c-afcb-e37cbb76ca87-etc-tuned\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.337915 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.337837    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8203791-5fa6-4800-90b6-ce0dce517ecb-ovn-node-metrics-cert\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.337915 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.337854    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/050c91f4-c50a-423a-8e94-f12a0076a702-agent-certs\") pod \"konnectivity-agent-m4jzh\" (UID: \"050c91f4-c50a-423a-8e94-f12a0076a702\") " pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.340991 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.340701    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:31:52.340991 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.340727    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:31:52.340991 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.340742    2567 projected.go:194] Error preparing data for projected volume kube-api-access-smgmm for pod openshift-network-diagnostics/network-check-target-jjlbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:52.340991 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.340811    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm podName:f643e286-44eb-4551-8a5d-f4269da41c7f nodeName:}" failed. No retries permitted until 2026-05-21 16:31:52.840792787 +0000 UTC m=+3.004525417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-smgmm" (UniqueName: "kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm") pod "network-check-target-jjlbt" (UID: "f643e286-44eb-4551-8a5d-f4269da41c7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:52.342208 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.342164    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59972\" (UniqueName: \"kubernetes.io/projected/e31daca4-2f26-47e6-a92b-0b7c00728d90-kube-api-access-59972\") pod \"aws-ebs-csi-driver-node-gqnbd\" (UID: \"e31daca4-2f26-47e6-a92b-0b7c00728d90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.342208 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.342181    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqbp\" (UniqueName: \"kubernetes.io/projected/5c928a47-ae3e-4ee9-9864-4bb35caea67d-kube-api-access-8kqbp\") pod \"iptables-alerter-s5lgl\" (UID: \"5c928a47-ae3e-4ee9-9864-4bb35caea67d\") " pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.342693 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.342668    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfrw4\" (UniqueName: \"kubernetes.io/projected/02c46b8c-6c40-47ce-8dc3-a46c30350906-kube-api-access-dfrw4\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:52.343720 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.343695    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxcrh\" (UniqueName: \"kubernetes.io/projected/76ceee66-b909-4d8c-afcb-e37cbb76ca87-kube-api-access-kxcrh\") pod \"tuned-rlpkd\" (UID: \"76ceee66-b909-4d8c-afcb-e37cbb76ca87\") " pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.343720 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.343711    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trj55\" (UniqueName: \"kubernetes.io/projected/77db0607-0f8c-4c1f-906c-7824dd957b28-kube-api-access-trj55\") pod \"node-resolver-sncdc\" (UID: \"77db0607-0f8c-4c1f-906c-7824dd957b28\") " pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.343855 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.343746    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z5wv\" (UniqueName: \"kubernetes.io/projected/b8203791-5fa6-4800-90b6-ce0dce517ecb-kube-api-access-7z5wv\") pod \"ovnkube-node-m87sz\" (UID: \"b8203791-5fa6-4800-90b6-ce0dce517ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.435888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.435851    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-k8s-cni-cncf-io\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436046 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.435902    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-cni-bin\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436046 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.435942    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-multus-certs\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436046 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.435962    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436046 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.435989    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzhsh\" (UniqueName: \"kubernetes.io/projected/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-kube-api-access-hzhsh\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.436046 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.435984    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-k8s-cni-cncf-io\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436046 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436029    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-756r5\" (UniqueName: \"kubernetes.io/projected/b58aa08a-5399-4e2d-a44c-428be7f298da-kube-api-access-756r5\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436046    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-multus-certs\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436054    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-system-cni-dir\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436087    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-hostroot\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436107    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436122    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-cni-bin\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436129    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-os-release\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436192    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-cnibin\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436210    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-system-cni-dir\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436226    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-daemon-config\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436262    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-host\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436288    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-serviceca\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.436321 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436297    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436326    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9nzh\" (UniqueName: \"kubernetes.io/projected/76377b5f-4ec3-427a-9392-81c53727f5c8-kube-api-access-p9nzh\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436339    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-host\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436365    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b58aa08a-5399-4e2d-a44c-428be7f298da-cni-binary-copy\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436390    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-hostroot\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436399    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-os-release\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436426    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-cni-multus\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436472    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-conf-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436498    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-cnibin\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436526    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436576    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-kubelet\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436602    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-etc-kubernetes\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436627    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-conf-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436615    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-os-release\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436654    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-netns\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436671    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-cni-multus\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436686    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-system-cni-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436709    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76377b5f-4ec3-427a-9392-81c53727f5c8-cnibin\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.436888 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436713    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436716    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436747    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-cni-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436760    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-os-release\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436776    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-socket-dir-parent\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436782    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-cnibin\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436790    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-run-netns\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436824    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-daemon-config\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436861    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-cni-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436866    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-system-cni-dir\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436871    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-host-var-lib-kubelet\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436867    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-multus-socket-dir-parent\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.436969    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58aa08a-5399-4e2d-a44c-428be7f298da-etc-kubernetes\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.437065    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b58aa08a-5399-4e2d-a44c-428be7f298da-cni-binary-copy\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.437109    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.437166    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76377b5f-4ec3-427a-9392-81c53727f5c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.437576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.437209    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-serviceca\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.444167 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.444140    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9nzh\" (UniqueName: \"kubernetes.io/projected/76377b5f-4ec3-427a-9392-81c53727f5c8-kube-api-access-p9nzh\") pod \"multus-additional-cni-plugins-ppxx2\" (UID: \"76377b5f-4ec3-427a-9392-81c53727f5c8\") " pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.444426 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.444406    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-756r5\" (UniqueName: \"kubernetes.io/projected/b58aa08a-5399-4e2d-a44c-428be7f298da-kube-api-access-756r5\") pod \"multus-xxhgn\" (UID: \"b58aa08a-5399-4e2d-a44c-428be7f298da\") " pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.444508 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.444404    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzhsh\" (UniqueName: \"kubernetes.io/projected/6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d-kube-api-access-hzhsh\") pod \"node-ca-lrsgr\" (UID: \"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d\") " pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.519479 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.519344    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:31:52.527269 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.527242    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:31:52.535907 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.535881    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd"
May 21 16:31:52.542632 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.542611    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rlpkd"
May 21 16:31:52.551203 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.551181    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5lgl"
May 21 16:31:52.556781 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.556762    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sncdc"
May 21 16:31:52.563273 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.563255    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrsgr"
May 21 16:31:52.570901 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.570878    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xxhgn"
May 21 16:31:52.574699 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.574680    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:31:52.575728 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.575707    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppxx2"
May 21 16:31:52.727066 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.727041    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050c91f4_c50a_423a_8e94_f12a0076a702.slice/crio-f914eae3bc2c98d8e36b2ff6494b10b00fdca4515f9f3ff989ad46d3835ef64f WatchSource:0}: Error finding container f914eae3bc2c98d8e36b2ff6494b10b00fdca4515f9f3ff989ad46d3835ef64f: Status 404 returned error can't find the container with id f914eae3bc2c98d8e36b2ff6494b10b00fdca4515f9f3ff989ad46d3835ef64f
May 21 16:31:52.728478 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.728391    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31daca4_2f26_47e6_a92b_0b7c00728d90.slice/crio-2e8f092834d13758d4689b9b7f1970acbe3215e0e59fda59cc952d43a4f6578e WatchSource:0}: Error finding container 2e8f092834d13758d4689b9b7f1970acbe3215e0e59fda59cc952d43a4f6578e: Status 404 returned error can't find the container with id 2e8f092834d13758d4689b9b7f1970acbe3215e0e59fda59cc952d43a4f6578e
May 21 16:31:52.729961 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.729847    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8203791_5fa6_4800_90b6_ce0dce517ecb.slice/crio-44910748caa9aa35f69f41d9e6bc6c8958be44d88dbc0a20ee5286d318ce1539 WatchSource:0}: Error finding container 44910748caa9aa35f69f41d9e6bc6c8958be44d88dbc0a20ee5286d318ce1539: Status 404 returned error can't find the container with id 44910748caa9aa35f69f41d9e6bc6c8958be44d88dbc0a20ee5286d318ce1539
May 21 16:31:52.732702 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.732617    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58aa08a_5399_4e2d_a44c_428be7f298da.slice/crio-b5e2b12d8dcb432358816434dd7036b2d0db2b7a12afa93355f3f1f1793e1f47 WatchSource:0}: Error finding container b5e2b12d8dcb432358816434dd7036b2d0db2b7a12afa93355f3f1f1793e1f47: Status 404 returned error can't find the container with id b5e2b12d8dcb432358816434dd7036b2d0db2b7a12afa93355f3f1f1793e1f47
May 21 16:31:52.733556 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.733523    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c928a47_ae3e_4ee9_9864_4bb35caea67d.slice/crio-f83aff798b5e3018a21fe93a64d9d0490a7e0c776c6bf57119f215fec1008be0 WatchSource:0}: Error finding container f83aff798b5e3018a21fe93a64d9d0490a7e0c776c6bf57119f215fec1008be0: Status 404 returned error can't find the container with id f83aff798b5e3018a21fe93a64d9d0490a7e0c776c6bf57119f215fec1008be0
May 21 16:31:52.734330 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.734237    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76377b5f_4ec3_427a_9392_81c53727f5c8.slice/crio-005e246c83e4e2206478f6562cf8ec75624effae68678be0c19a221f389969a4 WatchSource:0}: Error finding container 005e246c83e4e2206478f6562cf8ec75624effae68678be0c19a221f389969a4: Status 404 returned error can't find the container with id 005e246c83e4e2206478f6562cf8ec75624effae68678be0c19a221f389969a4
May 21 16:31:52.735135 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.735111    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ceee66_b909_4d8c_afcb_e37cbb76ca87.slice/crio-8fcd57d8dc387def994733e91dee976f1d35e45dc735d36c0026b5112ea96f4c WatchSource:0}: Error finding container 8fcd57d8dc387def994733e91dee976f1d35e45dc735d36c0026b5112ea96f4c: Status 404 returned error can't find the container with id 8fcd57d8dc387def994733e91dee976f1d35e45dc735d36c0026b5112ea96f4c
May 21 16:31:52.737717 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.736992    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec0b90a_32d9_47c2_b5cc_c41d6ec4cf8d.slice/crio-39f0fafc70d66b1bbd422b46ff58acf1c255bee95e89dccc43434e31013b8949 WatchSource:0}: Error finding container 39f0fafc70d66b1bbd422b46ff58acf1c255bee95e89dccc43434e31013b8949: Status 404 returned error can't find the container with id 39f0fafc70d66b1bbd422b46ff58acf1c255bee95e89dccc43434e31013b8949
May 21 16:31:52.738801 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:31:52.738558    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77db0607_0f8c_4c1f_906c_7824dd957b28.slice/crio-2397c9380e990e6a054ae8b34e9a22f370137780510e75cde9ef1b54fbd245be WatchSource:0}: Error finding container 2397c9380e990e6a054ae8b34e9a22f370137780510e75cde9ef1b54fbd245be: Status 404 returned error can't find the container with id 2397c9380e990e6a054ae8b34e9a22f370137780510e75cde9ef1b54fbd245be
May 21 16:31:52.839265 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.839243    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:52.839399 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.839355    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:52.839452 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.839417    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:31:53.839396671 +0000 UTC m=+4.003129301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:52.939556 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:52.939524    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:52.939741 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.939692    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:31:52.939741 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.939709    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:31:52.939741 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.939719    2567 projected.go:194] Error preparing data for projected volume kube-api-access-smgmm for pod openshift-network-diagnostics/network-check-target-jjlbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:52.939894 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:52.939793    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm podName:f643e286-44eb-4551-8a5d-f4269da41c7f nodeName:}" failed. No retries permitted until 2026-05-21 16:31:53.939765015 +0000 UTC m=+4.103497631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-smgmm" (UniqueName: "kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm") pod "network-check-target-jjlbt" (UID: "f643e286-44eb-4551-8a5d-f4269da41c7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:53.274266 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.274168    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:26:51 +0000 UTC" deadline="2027-12-19 11:02:34.888333578 +0000 UTC"
May 21 16:31:53.274266 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.274226    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13842h30m41.614125033s"
May 21 16:31:53.335322 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.335283    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrsgr" event={"ID":"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d","Type":"ContainerStarted","Data":"39f0fafc70d66b1bbd422b46ff58acf1c255bee95e89dccc43434e31013b8949"}
May 21 16:31:53.348383 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.348320    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rlpkd" event={"ID":"76ceee66-b909-4d8c-afcb-e37cbb76ca87","Type":"ContainerStarted","Data":"8fcd57d8dc387def994733e91dee976f1d35e45dc735d36c0026b5112ea96f4c"}
May 21 16:31:53.366579 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.366533    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5lgl" event={"ID":"5c928a47-ae3e-4ee9-9864-4bb35caea67d","Type":"ContainerStarted","Data":"f83aff798b5e3018a21fe93a64d9d0490a7e0c776c6bf57119f215fec1008be0"}
May 21 16:31:53.388073 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.388039    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xxhgn" event={"ID":"b58aa08a-5399-4e2d-a44c-428be7f298da","Type":"ContainerStarted","Data":"b5e2b12d8dcb432358816434dd7036b2d0db2b7a12afa93355f3f1f1793e1f47"}
May 21 16:31:53.392570 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.391800    2567 generic.go:358] "Generic (PLEG): container finished" podID="a545e22638b0cd0a34514d2cd76ed0e2" containerID="de1fd5e07739ef135b69248a16251b3412206abce91b1d7db7d0671791e26bec" exitCode=0
May 21 16:31:53.392570 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.391864    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" event={"ID":"a545e22638b0cd0a34514d2cd76ed0e2","Type":"ContainerDied","Data":"de1fd5e07739ef135b69248a16251b3412206abce91b1d7db7d0671791e26bec"}
May 21 16:31:53.406207 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.406137    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerStarted","Data":"005e246c83e4e2206478f6562cf8ec75624effae68678be0c19a221f389969a4"}
May 21 16:31:53.416018 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.415991    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"44910748caa9aa35f69f41d9e6bc6c8958be44d88dbc0a20ee5286d318ce1539"}
May 21 16:31:53.434100 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.433988    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd" event={"ID":"e31daca4-2f26-47e6-a92b-0b7c00728d90","Type":"ContainerStarted","Data":"2e8f092834d13758d4689b9b7f1970acbe3215e0e59fda59cc952d43a4f6578e"}
May 21 16:31:53.448008 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.447981    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4jzh" event={"ID":"050c91f4-c50a-423a-8e94-f12a0076a702","Type":"ContainerStarted","Data":"f914eae3bc2c98d8e36b2ff6494b10b00fdca4515f9f3ff989ad46d3835ef64f"}
May 21 16:31:53.450628 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.450604    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal" event={"ID":"218c7e0110a630061b5b90203b83e66e","Type":"ContainerStarted","Data":"344f91cf83d3a79f49533ee76576dee624f1b9c4c694ea1aad47a343a018fa0c"}
May 21 16:31:53.472899 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.472811    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sncdc" event={"ID":"77db0607-0f8c-4c1f-906c-7824dd957b28","Type":"ContainerStarted","Data":"2397c9380e990e6a054ae8b34e9a22f370137780510e75cde9ef1b54fbd245be"}
May 21 16:31:53.849316 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.849227    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:53.849498 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:53.849392    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:53.849498 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:53.849473    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:31:55.849438411 +0000 UTC m=+6.013171044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:53.949957 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:53.949919    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:53.950163 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:53.950124    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:31:53.950163 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:53.950151    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:31:53.950163 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:53.950163    2567 projected.go:194] Error preparing data for projected volume kube-api-access-smgmm for pod openshift-network-diagnostics/network-check-target-jjlbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:53.950327 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:53.950226    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm podName:f643e286-44eb-4551-8a5d-f4269da41c7f nodeName:}" failed. No retries permitted until 2026-05-21 16:31:55.95020628 +0000 UTC m=+6.113938897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-smgmm" (UniqueName: "kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm") pod "network-check-target-jjlbt" (UID: "f643e286-44eb-4551-8a5d-f4269da41c7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:54.318901 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:54.318829    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:54.319321 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:54.318954    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:31:54.319407 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:54.319366    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:54.319506 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:54.319473    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:31:54.494852 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:54.494512    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" event={"ID":"a545e22638b0cd0a34514d2cd76ed0e2","Type":"ContainerStarted","Data":"d33df73b7b1be872f605d6ecaeadcda396a14f59a287d140740b3cf9044b1efa"}
May 21 16:31:54.509485 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:54.509381    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal" podStartSLOduration=3.509364252 podStartE2EDuration="3.509364252s" podCreationTimestamp="2026-05-21 16:31:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:31:53.464942062 +0000 UTC m=+3.628674692" watchObservedRunningTime="2026-05-21 16:31:54.509364252 +0000 UTC m=+4.673096887"
May 21 16:31:55.864102 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:55.864060    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:55.864677 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:55.864195    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:55.864677 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:55.864347    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:31:59.864323372 +0000 UTC m=+10.028056000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:55.965438 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:55.964803    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:55.965438 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:55.964988    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:31:55.965438 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:55.965008    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:31:55.965438 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:55.965020    2567 projected.go:194] Error preparing data for projected volume kube-api-access-smgmm for pod openshift-network-diagnostics/network-check-target-jjlbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:55.965438 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:55.965080    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm podName:f643e286-44eb-4551-8a5d-f4269da41c7f nodeName:}" failed. No retries permitted until 2026-05-21 16:31:59.965060987 +0000 UTC m=+10.128793612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-smgmm" (UniqueName: "kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm") pod "network-check-target-jjlbt" (UID: "f643e286-44eb-4551-8a5d-f4269da41c7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:56.316486 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:56.316092    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:56.316486 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:56.316227    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:31:56.316486 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:56.316270    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:56.316874 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:56.316398    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:31:58.316639 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:58.316604    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:58.316639 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:58.316628    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:58.317076 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:58.316733    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:31:58.317076 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:58.316995    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:31:59.896217 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:59.896182    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:31:59.896761 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:59.896340    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:59.896761 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:59.896407    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:07.896389035 +0000 UTC m=+18.060121650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:31:59.997065 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:31:59.997013    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:31:59.997284 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:59.997204    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:31:59.997284 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:59.997224    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:31:59.997284 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:59.997238    2567 projected.go:194] Error preparing data for projected volume kube-api-access-smgmm for pod openshift-network-diagnostics/network-check-target-jjlbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:31:59.997445 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:31:59.997298    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm podName:f643e286-44eb-4551-8a5d-f4269da41c7f nodeName:}" failed. No retries permitted until 2026-05-21 16:32:07.997279499 +0000 UTC m=+18.161012127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-smgmm" (UniqueName: "kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm") pod "network-check-target-jjlbt" (UID: "f643e286-44eb-4551-8a5d-f4269da41c7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:32:00.317675 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:00.317102    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:00.317675 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:00.317208    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:00.317675 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:00.317544    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:00.317675 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:00.317637    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:02.315675 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:02.315639    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:02.316136 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:02.315778    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:02.316136 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:02.315954    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:02.316136 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:02.316071    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:04.316619 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:04.316585    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:04.316619 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:04.316607    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:04.317064 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:04.316695    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:04.317064 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:04.316845    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:06.316313 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:06.316286    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:06.316698 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:06.316286    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:06.316698 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:06.316390    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:06.316698 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:06.316480    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:07.954863 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:07.954809    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:07.955359 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:07.954993    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:32:07.955359 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:07.955079    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:23.955057333 +0000 UTC m=+34.118789947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:32:08.055272 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:08.055238    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:08.055437 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:08.055415    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:32:08.055521 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:08.055438    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:32:08.055521 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:08.055452    2567 projected.go:194] Error preparing data for projected volume kube-api-access-smgmm for pod openshift-network-diagnostics/network-check-target-jjlbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:32:08.055592 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:08.055541    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm podName:f643e286-44eb-4551-8a5d-f4269da41c7f nodeName:}" failed. No retries permitted until 2026-05-21 16:32:24.055520643 +0000 UTC m=+34.219253271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-smgmm" (UniqueName: "kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm") pod "network-check-target-jjlbt" (UID: "f643e286-44eb-4551-8a5d-f4269da41c7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:32:08.316538 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:08.316437    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:08.316704 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:08.316597    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:08.316704 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:08.316656    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:08.316829 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:08.316773    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:10.316932 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:10.316902    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:10.317406 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:10.317027    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:10.317406 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:10.317107    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:10.317406 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:10.317217    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:11.523904 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.523716    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4jzh" event={"ID":"050c91f4-c50a-423a-8e94-f12a0076a702","Type":"ContainerStarted","Data":"0b80a49e8e3fc06221031a83c0f1a5ab307c7319b19de4dc8a979d4aea362ade"}
May 21 16:32:11.524905 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.524879    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sncdc" event={"ID":"77db0607-0f8c-4c1f-906c-7824dd957b28","Type":"ContainerStarted","Data":"a8a7b08f5c93aa1cb189e8cd80b73ab3ffab4c5b65068ee163fee1f5aed62a29"}
May 21 16:32:11.525954 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.525927    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrsgr" event={"ID":"6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d","Type":"ContainerStarted","Data":"333bc811030bbfa20a521580061d2f403bd44b3287103ec447aa0715907740f1"}
May 21 16:32:11.527067 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.527045    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rlpkd" event={"ID":"76ceee66-b909-4d8c-afcb-e37cbb76ca87","Type":"ContainerStarted","Data":"6e3687eab44e1c7cca1512832e1f7f784d15cb829d7952dc3dc7d9c16048a7d2"}
May 21 16:32:11.528273 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.528251    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xxhgn" event={"ID":"b58aa08a-5399-4e2d-a44c-428be7f298da","Type":"ContainerStarted","Data":"ae8d377ab96a95345201bcb553e18a20cb90f6871b4d26c5da7d5018b20b5108"}
May 21 16:32:11.529426 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.529407    2567 generic.go:358] "Generic (PLEG): container finished" podID="76377b5f-4ec3-427a-9392-81c53727f5c8" containerID="6ab057de2825f2a747d0341da965e894a86cf05bcb914bd9d88ecbcf6183f35c" exitCode=0
May 21 16:32:11.529541 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.529497    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerDied","Data":"6ab057de2825f2a747d0341da965e894a86cf05bcb914bd9d88ecbcf6183f35c"}
May 21 16:32:11.531876 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.531857    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"040a9af4e4322789052dd624dbd8ffd69b9fbe2ecfd6fdf8d7850eca26dc965e"}
May 21 16:32:11.531954 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.531879    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"79e5aa8c087c45a4585cfdc760234f54a4a919e51ef54e594f663de75d73ce75"}
May 21 16:32:11.531954 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.531888    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"2884568d66f6cedead7833401665b2d5bfb053b8633cbe8c14aca60d8c464a80"}
May 21 16:32:11.531954 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.531904    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"b2c7c0b55781e5e9b98980793becab28f7001f4970affa95ba6bfca2f2d3279a"}
May 21 16:32:11.531954 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.531914    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"492c8b5a04d8c9519e2cdaf39fda767a032a08bf17a803e7d70b31bf83758991"}
May 21 16:32:11.533122 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.533105    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd" event={"ID":"e31daca4-2f26-47e6-a92b-0b7c00728d90","Type":"ContainerStarted","Data":"717be6528885fcde4fc37915c5bb5dd9492105760f94bea45306b7db51c246d3"}
May 21 16:32:11.539787 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.539754    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" podStartSLOduration=20.539744018 podStartE2EDuration="20.539744018s" podCreationTimestamp="2026-05-21 16:31:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:31:54.510644185 +0000 UTC m=+4.674376822" watchObservedRunningTime="2026-05-21 16:32:11.539744018 +0000 UTC m=+21.703476652"
May 21 16:32:11.540003 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.539984    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m4jzh" podStartSLOduration=8.13900197 podStartE2EDuration="21.539981258s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.728733493 +0000 UTC m=+2.892466120" lastFinishedPulling="2026-05-21 16:32:06.129712781 +0000 UTC m=+16.293445408" observedRunningTime="2026-05-21 16:32:11.539732852 +0000 UTC m=+21.703465486" watchObservedRunningTime="2026-05-21 16:32:11.539981258 +0000 UTC m=+21.703713910"
May 21 16:32:11.553780 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.553747    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rlpkd" podStartSLOduration=3.400093998 podStartE2EDuration="21.553736978s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.737825472 +0000 UTC m=+2.901558086" lastFinishedPulling="2026-05-21 16:32:10.891468445 +0000 UTC m=+21.055201066" observedRunningTime="2026-05-21 16:32:11.553557456 +0000 UTC m=+21.717290082" watchObservedRunningTime="2026-05-21 16:32:11.553736978 +0000 UTC m=+21.717469613"
May 21 16:32:11.567244 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.567212    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-sncdc" podStartSLOduration=3.417992588 podStartE2EDuration="21.56720397s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.74009025 +0000 UTC m=+2.903822863" lastFinishedPulling="2026-05-21 16:32:10.889301617 +0000 UTC m=+21.053034245" observedRunningTime="2026-05-21 16:32:11.567190483 +0000 UTC m=+21.730923117" watchObservedRunningTime="2026-05-21 16:32:11.56720397 +0000 UTC m=+21.730936602"
May 21 16:32:11.580130 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.580097    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lrsgr" podStartSLOduration=3.429580716 podStartE2EDuration="21.580087385s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.738797029 +0000 UTC m=+2.902529645" lastFinishedPulling="2026-05-21 16:32:10.889303686 +0000 UTC m=+21.053036314" observedRunningTime="2026-05-21 16:32:11.579915551 +0000 UTC m=+21.743648186" watchObservedRunningTime="2026-05-21 16:32:11.580087385 +0000 UTC m=+21.743820020"
May 21 16:32:11.595791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:11.595738    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xxhgn" podStartSLOduration=3.388888506 podStartE2EDuration="21.595728234s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.734634875 +0000 UTC m=+2.898367500" lastFinishedPulling="2026-05-21 16:32:10.94147461 +0000 UTC m=+21.105207228" observedRunningTime="2026-05-21 16:32:11.59558162 +0000 UTC m=+21.759314255" watchObservedRunningTime="2026-05-21 16:32:11.595728234 +0000 UTC m=+21.759460868"
May 21 16:32:12.316415 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:12.316390    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:12.316607 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:12.316390    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:12.316607 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:12.316521    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:12.316607 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:12.316572    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:12.536313 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:12.536282    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5lgl" event={"ID":"5c928a47-ae3e-4ee9-9864-4bb35caea67d","Type":"ContainerStarted","Data":"a4b1ae5c63f87d3cecf3267a06e0a77d94fc7a450a27405825fabd6479c8bb10"}
May 21 16:32:12.539143 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:12.539118    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"b5d32cc00356ffbfc684f199bc9f0155bf6b83dbcc4ada2c065dfe65a0bee9f8"}
May 21 16:32:12.549918 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:12.549871    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s5lgl" podStartSLOduration=4.398875264 podStartE2EDuration="22.549854077s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.735944274 +0000 UTC m=+2.899676901" lastFinishedPulling="2026-05-21 16:32:10.886923086 +0000 UTC m=+21.050655714" observedRunningTime="2026-05-21 16:32:12.549157805 +0000 UTC m=+22.712890441" watchObservedRunningTime="2026-05-21 16:32:12.549854077 +0000 UTC m=+22.713586712"
May 21 16:32:12.645613 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:12.645570    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 16:32:13.292391 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:13.292213    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T16:32:12.64559322Z","UUID":"0d05beff-ed62-41f9-bade-15cef097d570","Handler":null,"Name":"","Endpoint":""}
May 21 16:32:13.294143 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:13.294113    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 16:32:13.294278 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:13.294162    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 16:32:13.542334 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:13.542300    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd" event={"ID":"e31daca4-2f26-47e6-a92b-0b7c00728d90","Type":"ContainerStarted","Data":"ffd3bdab97f7a9c8a801485f41f5854933a057e94ec94a03bed06bed2acf95b6"}
May 21 16:32:14.316426 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:14.316392    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:14.316426 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:14.316409    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:14.316696 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:14.316537    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:14.316771 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:14.316691    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:14.549679 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:14.549643    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"10a10b3bdab50d9e14dcf2e5f2ac9a806d11355839b5e780f04d66ae052adf36"}
May 21 16:32:14.551595 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:14.551571    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd" event={"ID":"e31daca4-2f26-47e6-a92b-0b7c00728d90","Type":"ContainerStarted","Data":"2fc15c5ceec8d8a5ab8316fd5c4c519ecaca770ab7bef81875a4072b4342a492"}
May 21 16:32:14.566849 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:14.566749    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqnbd" podStartSLOduration=3.412896608 podStartE2EDuration="24.56673496s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.73084955 +0000 UTC m=+2.894582169" lastFinishedPulling="2026-05-21 16:32:13.884687894 +0000 UTC m=+24.048420521" observedRunningTime="2026-05-21 16:32:14.566631575 +0000 UTC m=+24.730364211" watchObservedRunningTime="2026-05-21 16:32:14.56673496 +0000 UTC m=+24.730467597"
May 21 16:32:15.755595 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:15.755560    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:32:15.756338 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:15.756317    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:32:16.318561 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.318387    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:16.318674 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.318396    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:16.318726 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:16.318663    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:16.318726 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:16.318708    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:16.557706 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.557608    2567 generic.go:358] "Generic (PLEG): container finished" podID="76377b5f-4ec3-427a-9392-81c53727f5c8" containerID="b81d7654c9d6aa6f0526a39176f44531a8d9575f2b7159bc169f6b6d947bda14" exitCode=0
May 21 16:32:16.557886 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.557701    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerDied","Data":"b81d7654c9d6aa6f0526a39176f44531a8d9575f2b7159bc169f6b6d947bda14"}
May 21 16:32:16.562843 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.562821    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" event={"ID":"b8203791-5fa6-4800-90b6-ce0dce517ecb","Type":"ContainerStarted","Data":"749604f4b682f93218601b56ab2e184da2f1dd0efb03b05ea4a8d2791680546c"}
May 21 16:32:16.563053 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.563027    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:32:16.574740 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.574715    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m4jzh"
May 21 16:32:16.609109 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:16.609074    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz" podStartSLOduration=8.388948477 podStartE2EDuration="26.609063571s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.732334058 +0000 UTC m=+2.896066670" lastFinishedPulling="2026-05-21 16:32:10.952449134 +0000 UTC m=+21.116181764" observedRunningTime="2026-05-21 16:32:16.60871323 +0000 UTC m=+26.772445865" watchObservedRunningTime="2026-05-21 16:32:16.609063571 +0000 UTC m=+26.772796205"
May 21 16:32:17.564569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.564535    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:32:17.564923 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.564578    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:32:17.564923 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.564591    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:32:17.579967 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.579941    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:32:17.580513 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.580494    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:32:17.973504 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.973263    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jjlbt"]
May 21 16:32:17.973688 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.973627    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:17.973764 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:17.973732    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:17.973916 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.973896    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kc2cf"]
May 21 16:32:17.974021 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:17.974006    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:17.974159 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:17.974138    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:18.567146 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:18.567115    2567 generic.go:358] "Generic (PLEG): container finished" podID="76377b5f-4ec3-427a-9392-81c53727f5c8" containerID="995cdb6d6df951668d272bb07131688d4ceee70519c926220a5431c978b2db71" exitCode=0
May 21 16:32:18.567645 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:18.567208    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerDied","Data":"995cdb6d6df951668d272bb07131688d4ceee70519c926220a5431c978b2db71"}
May 21 16:32:19.316488 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:19.316444    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:19.316650 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:19.316444    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:19.316650 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:19.316578    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:19.316650 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:19.316625    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:19.570451 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:19.570415    2567 generic.go:358] "Generic (PLEG): container finished" podID="76377b5f-4ec3-427a-9392-81c53727f5c8" containerID="b3452e69ba59503afb36451486b84dc95324fc09eafc272d36792fe8bde014fc" exitCode=0
May 21 16:32:19.570984 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:19.570560    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerDied","Data":"b3452e69ba59503afb36451486b84dc95324fc09eafc272d36792fe8bde014fc"}
May 21 16:32:21.315823 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:21.315783    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:21.315823 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:21.315815    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:21.316578 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:21.315917    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:21.316578 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:21.316043    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:23.316072 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.316038    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:23.316614 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.316038    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:23.316614 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.316173    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:32:23.316614 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.316215    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjlbt" podUID="f643e286-44eb-4551-8a5d-f4269da41c7f"
May 21 16:32:23.729093 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.729004    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeReady"
May 21 16:32:23.729252 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.729172    2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 16:32:23.772104 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.772072    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5bsk9"]
May 21 16:32:23.777142 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.777115    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ddxzv"]
May 21 16:32:23.777308 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.777287    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.779799 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.779689    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 16:32:23.779799 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.779773    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 16:32:23.779799 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.779785    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tnm5s\""
May 21 16:32:23.780563 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.780542    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:23.782105 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.782081    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ddxzv"]
May 21 16:32:23.782605 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.782562    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 16:32:23.782837 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.782807    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 16:32:23.783003 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.782953    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 16:32:23.783096 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.783059    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c67tk\""
May 21 16:32:23.785247 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.785228    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bsk9"]
May 21 16:32:23.881300 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.881070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72b5\" (UniqueName: \"kubernetes.io/projected/33549198-9578-4968-b8e1-6b47b2fbb150-kube-api-access-s72b5\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.881482 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.881340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:23.881482 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.881375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33549198-9578-4968-b8e1-6b47b2fbb150-config-volume\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.881482 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.881429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-795gl\" (UniqueName: \"kubernetes.io/projected/73fb1e00-d98d-4eb5-8068-a4b0994a9988-kube-api-access-795gl\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:23.881482 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.881452    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.881645 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.881487    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33549198-9578-4968-b8e1-6b47b2fbb150-tmp-dir\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.982531 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.982424    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s72b5\" (UniqueName: \"kubernetes.io/projected/33549198-9578-4968-b8e1-6b47b2fbb150-kube-api-access-s72b5\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.982704 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.982622    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:23.982704 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.982677    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33549198-9578-4968-b8e1-6b47b2fbb150-config-volume\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.982816 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.982722    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:23.982816 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.982758    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-795gl\" (UniqueName: \"kubernetes.io/projected/73fb1e00-d98d-4eb5-8068-a4b0994a9988-kube-api-access-795gl\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:23.982816 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.982768    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:32:23.982953 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.982833    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:24.482812718 +0000 UTC m=+34.646545346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:32:23.982953 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.982856    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:32:23.982953 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.982911    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:55.982895163 +0000 UTC m=+66.146627783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:32:23.982953 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.982934    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.983150 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.982963    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33549198-9578-4968-b8e1-6b47b2fbb150-tmp-dir\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.983150 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.983036    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:32:23.983150 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:23.983097    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:24.483082581 +0000 UTC m=+34.646815193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:32:23.983298 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.983267    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33549198-9578-4968-b8e1-6b47b2fbb150-tmp-dir\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.983404 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.983378    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33549198-9578-4968-b8e1-6b47b2fbb150-config-volume\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.993720 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.993694    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72b5\" (UniqueName: \"kubernetes.io/projected/33549198-9578-4968-b8e1-6b47b2fbb150-kube-api-access-s72b5\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:23.993902 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:23.993882    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-795gl\" (UniqueName: \"kubernetes.io/projected/73fb1e00-d98d-4eb5-8068-a4b0994a9988-kube-api-access-795gl\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:24.084310 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:24.084268    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:24.084561 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.084449    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:32:24.084561 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.084490    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:32:24.084561 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.084503    2567 projected.go:194] Error preparing data for projected volume kube-api-access-smgmm for pod openshift-network-diagnostics/network-check-target-jjlbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:32:24.084716 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.084569    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm podName:f643e286-44eb-4551-8a5d-f4269da41c7f nodeName:}" failed. No retries permitted until 2026-05-21 16:32:56.084548781 +0000 UTC m=+66.248281394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-smgmm" (UniqueName: "kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm") pod "network-check-target-jjlbt" (UID: "f643e286-44eb-4551-8a5d-f4269da41c7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:32:24.488332 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:24.488295    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:24.488783 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:24.488349    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:24.488783 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.488476    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:32:24.488783 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.488484    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:32:24.488783 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.488553    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:25.488524973 +0000 UTC m=+35.652257603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:32:24.488783 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:24.488571    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:25.488563749 +0000 UTC m=+35.652296367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:32:25.316055 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.316029    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:25.316229 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.316056    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:25.319931 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.319911    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 16:32:25.320062 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.319932    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 16:32:25.320062 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.319963    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w759t\""
May 21 16:32:25.320062 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.320008    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 16:32:25.320062 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.319909    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tq9vg\""
May 21 16:32:25.494901 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.494865    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:25.495341 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:25.495003    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:32:25.495341 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:25.495073    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:27.495054519 +0000 UTC m=+37.658787132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:32:25.495341 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:25.495098    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:25.495341 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:25.495176    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:32:25.495341 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:25.495204    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:27.495192974 +0000 UTC m=+37.658925588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:32:26.585040 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:26.585010    2567 generic.go:358] "Generic (PLEG): container finished" podID="76377b5f-4ec3-427a-9392-81c53727f5c8" containerID="3355f38eb2a31f1744724ea2b5346c326bbc3b8a1bf4196cf90c54d96e111835" exitCode=0
May 21 16:32:26.585436 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:26.585071    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerDied","Data":"3355f38eb2a31f1744724ea2b5346c326bbc3b8a1bf4196cf90c54d96e111835"}
May 21 16:32:27.512066 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:27.512028    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:27.512240 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:27.512083    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:27.512240 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:27.512172    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:32:27.512240 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:27.512173    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:32:27.512240 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:27.512225    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:31.512210451 +0000 UTC m=+41.675943065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:32:27.512240 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:27.512239    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:31.512233105 +0000 UTC m=+41.675965718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:32:27.589436 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:27.589406    2567 generic.go:358] "Generic (PLEG): container finished" podID="76377b5f-4ec3-427a-9392-81c53727f5c8" containerID="8b45078e15861abd11e586f669d812b3616594bdcf0cc7602b145f795be32c0c" exitCode=0
May 21 16:32:27.589831 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:27.589474    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerDied","Data":"8b45078e15861abd11e586f669d812b3616594bdcf0cc7602b145f795be32c0c"}
May 21 16:32:28.594165 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:28.594129    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" event={"ID":"76377b5f-4ec3-427a-9392-81c53727f5c8","Type":"ContainerStarted","Data":"ce4b351136e1e917c646ab67f34cc7b910ac78634679adefe8274f6b4a69ef9e"}
May 21 16:32:28.618706 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:28.618659    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppxx2" podStartSLOduration=5.268695266 podStartE2EDuration="38.618646386s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:31:52.737261884 +0000 UTC m=+2.900994512" lastFinishedPulling="2026-05-21 16:32:26.087213015 +0000 UTC m=+36.250945632" observedRunningTime="2026-05-21 16:32:28.61737246 +0000 UTC m=+38.781105095" watchObservedRunningTime="2026-05-21 16:32:28.618646386 +0000 UTC m=+38.782379021"
May 21 16:32:31.537576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:31.537535    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:31.537978 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:31.537619    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:31.537978 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:31.537693    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:32:31.537978 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:31.537717    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:32:31.537978 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:31.537762    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:39.537743943 +0000 UTC m=+49.701476571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:32:31.537978 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:31.537777    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:39.537770562 +0000 UTC m=+49.701503175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:32:39.590924 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:39.590887    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:39.591379 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:39.590950    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:39.591379 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:39.591039    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:32:39.591379 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:39.591038    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:32:39.591379 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:39.591116    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:55.591100459 +0000 UTC m=+65.754833073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:32:39.591379 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:39.591182    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:32:55.591167411 +0000 UTC m=+65.754900024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:32:49.588858 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:49.588831    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m87sz"
May 21 16:32:55.601669 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:55.601620    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:32:55.602059 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:55.601690    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:32:55.602059 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:55.601771    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:32:55.602059 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:55.601848    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:33:27.60183195 +0000 UTC m=+97.765564563 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:32:55.602059 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:55.601777    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:32:55.602059 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:55.601914    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:33:27.601901928 +0000 UTC m=+97.765634541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:32:56.004435 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.004351    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:32:56.007313 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.007297    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 16:32:56.014554 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:56.014540    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 16:32:56.014602 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:32:56.014591    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:34:00.014577471 +0000 UTC m=+130.178310089 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : secret "metrics-daemon-secret" not found
May 21 16:32:56.105283 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.105248    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:56.108108 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.108091    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 16:32:56.118495 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.118476    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 16:32:56.130604 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.130575    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smgmm\" (UniqueName: \"kubernetes.io/projected/f643e286-44eb-4551-8a5d-f4269da41c7f-kube-api-access-smgmm\") pod \"network-check-target-jjlbt\" (UID: \"f643e286-44eb-4551-8a5d-f4269da41c7f\") " pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:56.236701 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.236673    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w759t\""
May 21 16:32:56.244449 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.244432    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:56.423902 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.423875    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jjlbt"]
May 21 16:32:56.427188 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:32:56.427155    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf643e286_44eb_4551_8a5d_f4269da41c7f.slice/crio-8d7aef60d7a5ceac7ede7adf159df62cd9090914f9ef7eb0f5386b34a5b35b4b WatchSource:0}: Error finding container 8d7aef60d7a5ceac7ede7adf159df62cd9090914f9ef7eb0f5386b34a5b35b4b: Status 404 returned error can't find the container with id 8d7aef60d7a5ceac7ede7adf159df62cd9090914f9ef7eb0f5386b34a5b35b4b
May 21 16:32:56.646602 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:56.646536    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jjlbt" event={"ID":"f643e286-44eb-4551-8a5d-f4269da41c7f","Type":"ContainerStarted","Data":"8d7aef60d7a5ceac7ede7adf159df62cd9090914f9ef7eb0f5386b34a5b35b4b"}
May 21 16:32:59.653329 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:59.653295    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jjlbt" event={"ID":"f643e286-44eb-4551-8a5d-f4269da41c7f","Type":"ContainerStarted","Data":"8c40055f38c6e135ef27c0de49848636f1e84d36048e24510433a48a0d9ad745"}
May 21 16:32:59.653699 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:59.653449    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:32:59.668108 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:32:59.668063    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jjlbt" podStartSLOduration=66.8194581 podStartE2EDuration="1m9.668051327s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:32:56.428979815 +0000 UTC m=+66.592712429" lastFinishedPulling="2026-05-21 16:32:59.277573042 +0000 UTC m=+69.441305656" observedRunningTime="2026-05-21 16:32:59.667821499 +0000 UTC m=+69.831554134" watchObservedRunningTime="2026-05-21 16:32:59.668051327 +0000 UTC m=+69.831783956"
May 21 16:33:03.836786 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.836745    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"]
May 21 16:33:03.839766 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.839747    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"]
May 21 16:33:03.839912 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.839896    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:03.842558 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.842512    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xmbs4\""
May 21 16:33:03.842558 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.842520    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 16:33:03.842731 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.842687    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 16:33:03.842772 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.842737    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 16:33:03.842818 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.842774    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:03.843231 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.843216    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 16:33:03.844674 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.844655    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 16:33:03.847113 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.845395    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 16:33:03.847113 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.845490    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 16:33:03.847113 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.846235    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 16:33:03.852096 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.852079    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"]
May 21 16:33:03.852694 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.852674    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"]
May 21 16:33:03.957222 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957192    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwpmd\" (UniqueName: \"kubernetes.io/projected/fef69f03-724b-4330-93b3-a16086dabc40-kube-api-access-mwpmd\") pod \"managed-serviceaccount-addon-agent-5846495f76-t9vkx\" (UID: \"fef69f03-724b-4330-93b3-a16086dabc40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:03.957338 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-ca\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:03.957338 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:03.957338 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j7hc\" (UniqueName: \"kubernetes.io/projected/d3867791-9671-48b9-a2a5-4b23b955766a-kube-api-access-4j7hc\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:03.957446 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:03.957446 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef69f03-724b-4330-93b3-a16086dabc40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5846495f76-t9vkx\" (UID: \"fef69f03-724b-4330-93b3-a16086dabc40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:03.957446 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957390    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d3867791-9671-48b9-a2a5-4b23b955766a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:03.957446 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:03.957432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-hub\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.057874 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.057848    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.057987 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.057906    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef69f03-724b-4330-93b3-a16086dabc40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5846495f76-t9vkx\" (UID: \"fef69f03-724b-4330-93b3-a16086dabc40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:04.057987 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.057933    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d3867791-9671-48b9-a2a5-4b23b955766a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.057987 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.057965    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-hub\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.058134 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.058024    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwpmd\" (UniqueName: \"kubernetes.io/projected/fef69f03-724b-4330-93b3-a16086dabc40-kube-api-access-mwpmd\") pod \"managed-serviceaccount-addon-agent-5846495f76-t9vkx\" (UID: \"fef69f03-724b-4330-93b3-a16086dabc40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:04.058134 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.058055    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-ca\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.058134 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.058072    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.058134 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.058107    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4j7hc\" (UniqueName: \"kubernetes.io/projected/d3867791-9671-48b9-a2a5-4b23b955766a-kube-api-access-4j7hc\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.058833 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.058793    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d3867791-9671-48b9-a2a5-4b23b955766a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.060548 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.060518    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-ca\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.060694 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.060671    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.060760 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.060725    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.060928 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.060910    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3867791-9671-48b9-a2a5-4b23b955766a-hub\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.060982 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.060926    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fef69f03-724b-4330-93b3-a16086dabc40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5846495f76-t9vkx\" (UID: \"fef69f03-724b-4330-93b3-a16086dabc40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:04.066185 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.066151    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwpmd\" (UniqueName: \"kubernetes.io/projected/fef69f03-724b-4330-93b3-a16086dabc40-kube-api-access-mwpmd\") pod \"managed-serviceaccount-addon-agent-5846495f76-t9vkx\" (UID: \"fef69f03-724b-4330-93b3-a16086dabc40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:04.066901 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.066880    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j7hc\" (UniqueName: \"kubernetes.io/projected/d3867791-9671-48b9-a2a5-4b23b955766a-kube-api-access-4j7hc\") pod \"cluster-proxy-proxy-agent-b5c748d9c-dmbx4\" (UID: \"d3867791-9671-48b9-a2a5-4b23b955766a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.158443 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.158394    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"
May 21 16:33:04.165067 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.165047    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:33:04.301531 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.301500    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx"]
May 21 16:33:04.304824 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:33:04.304797    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfef69f03_724b_4330_93b3_a16086dabc40.slice/crio-c46725017536f5ccf381a314213fcc17c04f61c12def13835ab624ad5ba6cb67 WatchSource:0}: Error finding container c46725017536f5ccf381a314213fcc17c04f61c12def13835ab624ad5ba6cb67: Status 404 returned error can't find the container with id c46725017536f5ccf381a314213fcc17c04f61c12def13835ab624ad5ba6cb67
May 21 16:33:04.318754 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.318735    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"]
May 21 16:33:04.321213 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:33:04.321187    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3867791_9671_48b9_a2a5_4b23b955766a.slice/crio-fea1a1f8fbc5001e5d3618c08d4401d02623233bdb4836607365c0b0f315e4ff WatchSource:0}: Error finding container fea1a1f8fbc5001e5d3618c08d4401d02623233bdb4836607365c0b0f315e4ff: Status 404 returned error can't find the container with id fea1a1f8fbc5001e5d3618c08d4401d02623233bdb4836607365c0b0f315e4ff
May 21 16:33:04.664492 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.664449    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" event={"ID":"d3867791-9671-48b9-a2a5-4b23b955766a","Type":"ContainerStarted","Data":"fea1a1f8fbc5001e5d3618c08d4401d02623233bdb4836607365c0b0f315e4ff"}
May 21 16:33:04.665416 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:04.665396    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx" event={"ID":"fef69f03-724b-4330-93b3-a16086dabc40","Type":"ContainerStarted","Data":"c46725017536f5ccf381a314213fcc17c04f61c12def13835ab624ad5ba6cb67"}
May 21 16:33:09.678043 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:09.678005    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" event={"ID":"d3867791-9671-48b9-a2a5-4b23b955766a","Type":"ContainerStarted","Data":"270e7dd94a1f9a209ae9d50709173a1a8a04d21dd4c31568c5870d478c8c4680"}
May 21 16:33:09.679856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:09.679822    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx" event={"ID":"fef69f03-724b-4330-93b3-a16086dabc40","Type":"ContainerStarted","Data":"96384119e17927bb7fd69d6a52a27e66df9423fffe98fe34891891d8a7c203ca"}
May 21 16:33:09.694778 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:09.694731    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5846495f76-t9vkx" podStartSLOduration=2.370771748 podStartE2EDuration="6.694716174s" podCreationTimestamp="2026-05-21 16:33:03 +0000 UTC" firstStartedPulling="2026-05-21 16:33:04.306699767 +0000 UTC m=+74.470432380" lastFinishedPulling="2026-05-21 16:33:08.63064419 +0000 UTC m=+78.794376806" observedRunningTime="2026-05-21 16:33:09.694607639 +0000 UTC m=+79.858340275" watchObservedRunningTime="2026-05-21 16:33:09.694716174 +0000 UTC m=+79.858448812"
May 21 16:33:11.685685 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:11.685620    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" event={"ID":"d3867791-9671-48b9-a2a5-4b23b955766a","Type":"ContainerStarted","Data":"7a83733d7566cd43300549ffb1a4667c9a52f4650060743dd4eaac498de0ef70"}
May 21 16:33:11.685685 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:11.685651    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" event={"ID":"d3867791-9671-48b9-a2a5-4b23b955766a","Type":"ContainerStarted","Data":"44999fa6e209138b67cfaf66015c9862e16bc1266fd47209ab21fd52af11b389"}
May 21 16:33:11.704002 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:11.703963    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" podStartSLOduration=1.633684114 podStartE2EDuration="8.703951236s" podCreationTimestamp="2026-05-21 16:33:03 +0000 UTC" firstStartedPulling="2026-05-21 16:33:04.322754871 +0000 UTC m=+74.486487484" lastFinishedPulling="2026-05-21 16:33:11.393021994 +0000 UTC m=+81.556754606" observedRunningTime="2026-05-21 16:33:11.703220688 +0000 UTC m=+81.866953322" watchObservedRunningTime="2026-05-21 16:33:11.703951236 +0000 UTC m=+81.867683870"
May 21 16:33:27.615133 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:27.615091    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:33:27.615543 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:27.615164    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:33:27.615543 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:33:27.615249    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:33:27.615543 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:33:27.615252    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:33:27.615543 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:33:27.615298    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls podName:33549198-9578-4968-b8e1-6b47b2fbb150 nodeName:}" failed. No retries permitted until 2026-05-21 16:34:31.615284839 +0000 UTC m=+161.779017452 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls") pod "dns-default-5bsk9" (UID: "33549198-9578-4968-b8e1-6b47b2fbb150") : secret "dns-default-metrics-tls" not found
May 21 16:33:27.615543 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:33:27.615324    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert podName:73fb1e00-d98d-4eb5-8068-a4b0994a9988 nodeName:}" failed. No retries permitted until 2026-05-21 16:34:31.615307511 +0000 UTC m=+161.779040128 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert") pod "ingress-canary-ddxzv" (UID: "73fb1e00-d98d-4eb5-8068-a4b0994a9988") : secret "canary-serving-cert" not found
May 21 16:33:30.657628 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:33:30.657598    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jjlbt"
May 21 16:34:00.026008 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:00.025963    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:34:00.026537 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:34:00.026089    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 16:34:00.026537 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:34:00.026150    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs podName:02c46b8c-6c40-47ce-8dc3-a46c30350906 nodeName:}" failed. No retries permitted until 2026-05-21 16:36:02.026135755 +0000 UTC m=+252.189868371 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs") pod "network-metrics-daemon-kc2cf" (UID: "02c46b8c-6c40-47ce-8dc3-a46c30350906") : secret "metrics-daemon-secret" not found
May 21 16:34:19.336616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:19.336588    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sncdc_77db0607-0f8c-4c1f-906c-7824dd957b28/dns-node-resolver/0.log"
May 21 16:34:20.337415 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:20.337389    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrsgr_6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d/node-ca/0.log"
May 21 16:34:26.790173 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:34:26.790135    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5bsk9" podUID="33549198-9578-4968-b8e1-6b47b2fbb150"
May 21 16:34:26.796230 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:34:26.796200    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ddxzv" podUID="73fb1e00-d98d-4eb5-8068-a4b0994a9988"
May 21 16:34:26.825898 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:26.825872    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:34:26.826003 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:26.825911    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bsk9"
May 21 16:34:28.328344 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:34:28.328306    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kc2cf" podUID="02c46b8c-6c40-47ce-8dc3-a46c30350906"
May 21 16:34:31.631237 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.631198    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:34:31.631749 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.631249    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:34:31.633528 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.633507    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33549198-9578-4968-b8e1-6b47b2fbb150-metrics-tls\") pod \"dns-default-5bsk9\" (UID: \"33549198-9578-4968-b8e1-6b47b2fbb150\") " pod="openshift-dns/dns-default-5bsk9"
May 21 16:34:31.633580 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.633554    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73fb1e00-d98d-4eb5-8068-a4b0994a9988-cert\") pod \"ingress-canary-ddxzv\" (UID: \"73fb1e00-d98d-4eb5-8068-a4b0994a9988\") " pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:34:31.930520 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.930436    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c67tk\""
May 21 16:34:31.931074 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.931051    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tnm5s\""
May 21 16:34:31.936896 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.936878    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bsk9"
May 21 16:34:31.936988 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:31.936972    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ddxzv"
May 21 16:34:32.061702 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:32.061644    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ddxzv"]
May 21 16:34:32.065061 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:34:32.065035    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73fb1e00_d98d_4eb5_8068_a4b0994a9988.slice/crio-ed6156ee55c0267f935fadc7acd22d6b5803f4757196c609a7c3c27c6bc31cdd WatchSource:0}: Error finding container ed6156ee55c0267f935fadc7acd22d6b5803f4757196c609a7c3c27c6bc31cdd: Status 404 returned error can't find the container with id ed6156ee55c0267f935fadc7acd22d6b5803f4757196c609a7c3c27c6bc31cdd
May 21 16:34:32.075680 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:32.075660    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bsk9"]
May 21 16:34:32.078303 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:34:32.078283    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33549198_9578_4968_b8e1_6b47b2fbb150.slice/crio-da36546cd8949b8633ee34931ed662e573f77d461bf08077971ddc5b353d5cf9 WatchSource:0}: Error finding container da36546cd8949b8633ee34931ed662e573f77d461bf08077971ddc5b353d5cf9: Status 404 returned error can't find the container with id da36546cd8949b8633ee34931ed662e573f77d461bf08077971ddc5b353d5cf9
May 21 16:34:32.838551 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:32.838488    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ddxzv" event={"ID":"73fb1e00-d98d-4eb5-8068-a4b0994a9988","Type":"ContainerStarted","Data":"ed6156ee55c0267f935fadc7acd22d6b5803f4757196c609a7c3c27c6bc31cdd"}
May 21 16:34:32.839952 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:32.839918    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bsk9" event={"ID":"33549198-9578-4968-b8e1-6b47b2fbb150","Type":"ContainerStarted","Data":"da36546cd8949b8633ee34931ed662e573f77d461bf08077971ddc5b353d5cf9"}
May 21 16:34:33.846300 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:33.846254    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bsk9" event={"ID":"33549198-9578-4968-b8e1-6b47b2fbb150","Type":"ContainerStarted","Data":"646d0b78003ca647ca8701be2a588d37491b55caef8e65d8f867dffb4ace429a"}
May 21 16:34:33.846748 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:33.846308    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bsk9" event={"ID":"33549198-9578-4968-b8e1-6b47b2fbb150","Type":"ContainerStarted","Data":"ed98c2f0f11ad67e8a11ad6c14979f1666829acd0678a5ea5a35fe41472e1e2a"}
May 21 16:34:33.846748 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:33.846379    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5bsk9"
May 21 16:34:33.864194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:33.864155    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-5bsk9" podStartSLOduration=129.63007768 podStartE2EDuration="2m10.864143259s" podCreationTimestamp="2026-05-21 16:32:23 +0000 UTC" firstStartedPulling="2026-05-21 16:34:32.079842277 +0000 UTC m=+162.243574890" lastFinishedPulling="2026-05-21 16:34:33.313907856 +0000 UTC m=+163.477640469" observedRunningTime="2026-05-21 16:34:33.862139019 +0000 UTC m=+164.025871656" watchObservedRunningTime="2026-05-21 16:34:33.864143259 +0000 UTC m=+164.027875893"
May 21 16:34:34.850025 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:34.849942    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ddxzv" event={"ID":"73fb1e00-d98d-4eb5-8068-a4b0994a9988","Type":"ContainerStarted","Data":"d69c34a42b67291e46e8c48fd06b41eb1e8826aebd372ba498054a8d6d13a33c"}
May 21 16:34:34.864395 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:34.864352    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ddxzv" podStartSLOduration=129.347389797 podStartE2EDuration="2m11.864336973s" podCreationTimestamp="2026-05-21 16:32:23 +0000 UTC" firstStartedPulling="2026-05-21 16:34:32.066824725 +0000 UTC m=+162.230557338" lastFinishedPulling="2026-05-21 16:34:34.583771887 +0000 UTC m=+164.747504514" observedRunningTime="2026-05-21 16:34:34.863533824 +0000 UTC m=+165.027266456" watchObservedRunningTime="2026-05-21 16:34:34.864336973 +0000 UTC m=+165.028069627"
May 21 16:34:40.989512 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:40.989422    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58c8d547f7-n7hfk"]
May 21 16:34:40.991114 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:40.991098    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:40.993375 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:40.993352    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8vm2s\""
May 21 16:34:40.993748 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:40.993730    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 16:34:40.994555 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:40.994538    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 16:34:40.994643 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:40.994541    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 16:34:40.999356 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:40.999337    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 16:34:41.001363 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.001344    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lpq4h"]
May 21 16:34:41.003120 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.003103    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.005533 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.005503    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 16:34:41.005694 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.005559    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 16:34:41.005832 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.005810    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c2kc8\""
May 21 16:34:41.006106 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.006090    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 16:34:41.006364 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.006349    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 16:34:41.006567 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.006549    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c8d547f7-n7hfk"]
May 21 16:34:41.018627 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.018608    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lpq4h"]
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e04fb50-d402-4ff0-a6ad-34f0956080fe-image-registry-private-configuration\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e04fb50-d402-4ff0-a6ad-34f0956080fe-trusted-ca\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-registry-tls\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086750    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-bound-sa-token\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086795    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e04fb50-d402-4ff0-a6ad-34f0956080fe-installation-pull-secrets\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e04fb50-d402-4ff0-a6ad-34f0956080fe-registry-certificates\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e04fb50-d402-4ff0-a6ad-34f0956080fe-ca-trust-extracted\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.088658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.086906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmz4\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-kube-api-access-czmz4\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.187678 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187650    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8775f11-d28d-4da5-899f-3c9f9efd62a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.187811 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187688    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8775f11-d28d-4da5-899f-3c9f9efd62a1-crio-socket\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.187811 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187744    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e04fb50-d402-4ff0-a6ad-34f0956080fe-image-registry-private-configuration\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.187811 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187770    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e04fb50-d402-4ff0-a6ad-34f0956080fe-trusted-ca\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.187983 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187832    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-registry-tls\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.187983 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187860    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-bound-sa-token\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.187983 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8775f11-d28d-4da5-899f-3c9f9efd62a1-data-volume\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.187983 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8775f11-d28d-4da5-899f-3c9f9efd62a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.187983 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187962    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e04fb50-d402-4ff0-a6ad-34f0956080fe-installation-pull-secrets\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.188233 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.187988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ssvs\" (UniqueName: \"kubernetes.io/projected/b8775f11-d28d-4da5-899f-3c9f9efd62a1-kube-api-access-5ssvs\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.188233 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.188040    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e04fb50-d402-4ff0-a6ad-34f0956080fe-registry-certificates\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.188233 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.188075    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e04fb50-d402-4ff0-a6ad-34f0956080fe-ca-trust-extracted\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.188233 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.188099    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czmz4\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-kube-api-access-czmz4\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.188484 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.188447    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e04fb50-d402-4ff0-a6ad-34f0956080fe-ca-trust-extracted\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.188813 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.188793    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e04fb50-d402-4ff0-a6ad-34f0956080fe-registry-certificates\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.188893 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.188817    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e04fb50-d402-4ff0-a6ad-34f0956080fe-trusted-ca\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.190123 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.190099    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e04fb50-d402-4ff0-a6ad-34f0956080fe-image-registry-private-configuration\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.190559 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.190537    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-registry-tls\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.190637 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.190581    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e04fb50-d402-4ff0-a6ad-34f0956080fe-installation-pull-secrets\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.197250 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.197226    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-bound-sa-token\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.198209 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.198178    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmz4\" (UniqueName: \"kubernetes.io/projected/1e04fb50-d402-4ff0-a6ad-34f0956080fe-kube-api-access-czmz4\") pod \"image-registry-58c8d547f7-n7hfk\" (UID: \"1e04fb50-d402-4ff0-a6ad-34f0956080fe\") " pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.289139 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289120    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8775f11-d28d-4da5-899f-3c9f9efd62a1-data-volume\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.289228 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289149    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8775f11-d28d-4da5-899f-3c9f9efd62a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.289228 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289168    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ssvs\" (UniqueName: \"kubernetes.io/projected/b8775f11-d28d-4da5-899f-3c9f9efd62a1-kube-api-access-5ssvs\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.289228 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289195    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8775f11-d28d-4da5-899f-3c9f9efd62a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.289228 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289212    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8775f11-d28d-4da5-899f-3c9f9efd62a1-crio-socket\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.289428 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289290    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8775f11-d28d-4da5-899f-3c9f9efd62a1-crio-socket\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.289428 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289407    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8775f11-d28d-4da5-899f-3c9f9efd62a1-data-volume\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.289694 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.289668    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8775f11-d28d-4da5-899f-3c9f9efd62a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.291111 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.291094    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8775f11-d28d-4da5-899f-3c9f9efd62a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.297725 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.297708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ssvs\" (UniqueName: \"kubernetes.io/projected/b8775f11-d28d-4da5-899f-3c9f9efd62a1-kube-api-access-5ssvs\") pod \"insights-runtime-extractor-lpq4h\" (UID: \"b8775f11-d28d-4da5-899f-3c9f9efd62a1\") " pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.299677 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.299663    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.311851 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.311831    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lpq4h"
May 21 16:34:41.316565 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.316544    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:34:41.454788 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:34:41.454758    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e04fb50_d402_4ff0_a6ad_34f0956080fe.slice/crio-f0ab00bd7aba413bb0e3a7ca15e4522df67b3603283c414dd4ab49140dca5f81 WatchSource:0}: Error finding container f0ab00bd7aba413bb0e3a7ca15e4522df67b3603283c414dd4ab49140dca5f81: Status 404 returned error can't find the container with id f0ab00bd7aba413bb0e3a7ca15e4522df67b3603283c414dd4ab49140dca5f81
May 21 16:34:41.456591 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.456569    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c8d547f7-n7hfk"]
May 21 16:34:41.467964 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.467940    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lpq4h"]
May 21 16:34:41.470874 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:34:41.470851    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8775f11_d28d_4da5_899f_3c9f9efd62a1.slice/crio-68e1ef45cfdbd0cd0913cdeb2c6b833875bcbb416dcc1adc83ed59007e7e485f WatchSource:0}: Error finding container 68e1ef45cfdbd0cd0913cdeb2c6b833875bcbb416dcc1adc83ed59007e7e485f: Status 404 returned error can't find the container with id 68e1ef45cfdbd0cd0913cdeb2c6b833875bcbb416dcc1adc83ed59007e7e485f
May 21 16:34:41.872915 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.872863    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk" event={"ID":"1e04fb50-d402-4ff0-a6ad-34f0956080fe","Type":"ContainerStarted","Data":"badaf78bb91d426af3c981fd00e94058f74139d8d3a6f7a45c4ed439a8cd7d09"}
May 21 16:34:41.872915 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.872904    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk" event={"ID":"1e04fb50-d402-4ff0-a6ad-34f0956080fe","Type":"ContainerStarted","Data":"f0ab00bd7aba413bb0e3a7ca15e4522df67b3603283c414dd4ab49140dca5f81"}
May 21 16:34:41.873164 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.872982    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:34:41.874235 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.874212    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpq4h" event={"ID":"b8775f11-d28d-4da5-899f-3c9f9efd62a1","Type":"ContainerStarted","Data":"1201461d48670dabeed8550868a174d8896b72d01c772849ff28c313f5cd7543"}
May 21 16:34:41.874331 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.874239    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpq4h" event={"ID":"b8775f11-d28d-4da5-899f-3c9f9efd62a1","Type":"ContainerStarted","Data":"68e1ef45cfdbd0cd0913cdeb2c6b833875bcbb416dcc1adc83ed59007e7e485f"}
May 21 16:34:41.892887 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:41.892848    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk" podStartSLOduration=1.892835196 podStartE2EDuration="1.892835196s" podCreationTimestamp="2026-05-21 16:34:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:34:41.891904973 +0000 UTC m=+172.055637609" watchObservedRunningTime="2026-05-21 16:34:41.892835196 +0000 UTC m=+172.056567830"
May 21 16:34:42.877719 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:42.877689    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpq4h" event={"ID":"b8775f11-d28d-4da5-899f-3c9f9efd62a1","Type":"ContainerStarted","Data":"64d50f397599f147da1a4491a2b2613847c0008587db869896c105a9b0f82eca"}
May 21 16:34:43.852507 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:43.852473    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5bsk9"
May 21 16:34:44.166157 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:44.166068    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" podUID="d3867791-9671-48b9-a2a5-4b23b955766a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:34:44.888858 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:44.888824    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpq4h" event={"ID":"b8775f11-d28d-4da5-899f-3c9f9efd62a1","Type":"ContainerStarted","Data":"8268e2ac40ca3ed56ad3718ed555c4ef0b7b5e184874122dc25f0744376c18a7"}
May 21 16:34:44.906688 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:44.906647    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lpq4h" podStartSLOduration=2.126083857 podStartE2EDuration="4.906635226s" podCreationTimestamp="2026-05-21 16:34:40 +0000 UTC" firstStartedPulling="2026-05-21 16:34:41.508982021 +0000 UTC m=+171.672714634" lastFinishedPulling="2026-05-21 16:34:44.28953339 +0000 UTC m=+174.453266003" observedRunningTime="2026-05-21 16:34:44.905390704 +0000 UTC m=+175.069123339" watchObservedRunningTime="2026-05-21 16:34:44.906635226 +0000 UTC m=+175.070367900"
May 21 16:34:54.166260 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:54.166221    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" podUID="d3867791-9671-48b9-a2a5-4b23b955766a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:34:57.002495 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.002445    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rgrvb"]
May 21 16:34:57.008293 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.008271    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.011126 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.011106    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 16:34:57.011222 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.011189    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4j794\""
May 21 16:34:57.011300 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.011272    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 16:34:57.011384 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.011371    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 16:34:57.012206 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.012191    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 16:34:57.012271 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.012194    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 16:34:57.012325 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.012196    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 16:34:57.102652 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-root\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102766 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-tls\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102766 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102707    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102766 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102732    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-sys\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102766 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102755    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-wtmp\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102922 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-metrics-client-ca\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102922 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc72c\" (UniqueName: \"kubernetes.io/projected/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-kube-api-access-dc72c\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102922 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-textfile\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.102922 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.102888    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.203731 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.203709    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc72c\" (UniqueName: \"kubernetes.io/projected/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-kube-api-access-dc72c\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.203838 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.203742    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-textfile\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.203838 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.203763    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.203943 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.203910    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-root\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.203992 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.203963    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-tls\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204045 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204004    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-root\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204045 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204016    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204142 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204044    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-sys\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204142 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204071    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-wtmp\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204142 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204069    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-textfile\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204142 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204102    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-metrics-client-ca\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204397 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204141    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-sys\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204397 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204202    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-wtmp\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204667 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204650    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-metrics-client-ca\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.204731 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.204688    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.206180 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.206161    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-tls\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.206270 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.206253    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.222810 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.222788    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc72c\" (UniqueName: \"kubernetes.io/projected/4187f12f-1f85-4c9a-bcee-acd75a3e7e9e-kube-api-access-dc72c\") pod \"node-exporter-rgrvb\" (UID: \"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e\") " pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.317071 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.317047    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgrvb"
May 21 16:34:57.324613 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:34:57.324589    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4187f12f_1f85_4c9a_bcee_acd75a3e7e9e.slice/crio-303f69060ca5267a5e345bd208adfe574771dfcfb870a1eab60d6784cad931c3 WatchSource:0}: Error finding container 303f69060ca5267a5e345bd208adfe574771dfcfb870a1eab60d6784cad931c3: Status 404 returned error can't find the container with id 303f69060ca5267a5e345bd208adfe574771dfcfb870a1eab60d6784cad931c3
May 21 16:34:57.921451 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:57.921415    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgrvb" event={"ID":"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e","Type":"ContainerStarted","Data":"303f69060ca5267a5e345bd208adfe574771dfcfb870a1eab60d6784cad931c3"}
May 21 16:34:58.925448 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:58.925414    2567 generic.go:358] "Generic (PLEG): container finished" podID="4187f12f-1f85-4c9a-bcee-acd75a3e7e9e" containerID="a31ba4e89827cc78fdcc4eafde586a1893b4bd1784db7317032e22992c2d8a16" exitCode=0
May 21 16:34:58.925830 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:58.925495    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgrvb" event={"ID":"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e","Type":"ContainerDied","Data":"a31ba4e89827cc78fdcc4eafde586a1893b4bd1784db7317032e22992c2d8a16"}
May 21 16:34:59.929673 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:59.929642    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgrvb" event={"ID":"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e","Type":"ContainerStarted","Data":"3d9bb51f19e6869e8e54d4c327d267fdf1a4faa9d567ca6dde2d04b38effe41a"}
May 21 16:34:59.929673 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:59.929677    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgrvb" event={"ID":"4187f12f-1f85-4c9a-bcee-acd75a3e7e9e","Type":"ContainerStarted","Data":"e818b4b7c754d489941e630a7ab42b810a2c84e843e2e1f50601735efa56af42"}
May 21 16:34:59.960016 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:34:59.959971    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rgrvb" podStartSLOduration=2.9924116290000002 podStartE2EDuration="3.959956718s" podCreationTimestamp="2026-05-21 16:34:56 +0000 UTC" firstStartedPulling="2026-05-21 16:34:57.327024793 +0000 UTC m=+187.490757420" lastFinishedPulling="2026-05-21 16:34:58.294569886 +0000 UTC m=+188.458302509" observedRunningTime="2026-05-21 16:34:59.958678547 +0000 UTC m=+190.122411185" watchObservedRunningTime="2026-05-21 16:34:59.959956718 +0000 UTC m=+190.123689382"
May 21 16:35:02.881997 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:02.881965    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58c8d547f7-n7hfk"
May 21 16:35:04.166390 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:04.166353    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" podUID="d3867791-9671-48b9-a2a5-4b23b955766a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:35:04.166781 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:04.166417    2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4"
May 21 16:35:04.166926 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:04.166889    2567 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7a83733d7566cd43300549ffb1a4667c9a52f4650060743dd4eaac498de0ef70"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 16:35:04.166988 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:04.166973    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" podUID="d3867791-9671-48b9-a2a5-4b23b955766a" containerName="service-proxy" containerID="cri-o://7a83733d7566cd43300549ffb1a4667c9a52f4650060743dd4eaac498de0ef70" gracePeriod=30
May 21 16:35:04.944058 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:04.944025    2567 generic.go:358] "Generic (PLEG): container finished" podID="d3867791-9671-48b9-a2a5-4b23b955766a" containerID="7a83733d7566cd43300549ffb1a4667c9a52f4650060743dd4eaac498de0ef70" exitCode=2
May 21 16:35:04.944205 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:04.944099    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" event={"ID":"d3867791-9671-48b9-a2a5-4b23b955766a","Type":"ContainerDied","Data":"7a83733d7566cd43300549ffb1a4667c9a52f4650060743dd4eaac498de0ef70"}
May 21 16:35:04.944205 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:04.944136    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5c748d9c-dmbx4" event={"ID":"d3867791-9671-48b9-a2a5-4b23b955766a","Type":"ContainerStarted","Data":"5293b4a2d7aec964bac7345ec3a25a20e2cb97050beee26db5b307f805d9ef75"}
May 21 16:35:22.675293 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.675254    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6977d9d77d-4wd9l"]
May 21 16:35:22.677183 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.677167    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.679827 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.679807    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 16:35:22.679925 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.679807    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 16:35:22.680962 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.680937    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-56r7t\""
May 21 16:35:22.681147 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.680972    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 16:35:22.681147 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.680998    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 16:35:22.681297 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.681251    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 16:35:22.681297 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.681274    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 16:35:22.681406 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.681301    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 16:35:22.684947 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.684929    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 16:35:22.691111 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.691093    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6977d9d77d-4wd9l"]
May 21 16:35:22.783723 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.783699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6jhx\" (UniqueName: \"kubernetes.io/projected/48195c89-8e32-4f95-a972-e92b1ce7ef9d-kube-api-access-w6jhx\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.783832 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.783742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-trusted-ca-bundle\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.783832 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.783767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-service-ca\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.783832 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.783816    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-oauth-serving-cert\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.783943 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.783860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-config\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.783943 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.783888    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-serving-cert\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.783943 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.783905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-oauth-config\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.884473 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.884439    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-trusted-ca-bundle\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.884565 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.884499    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-service-ca\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.884565 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.884531    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-oauth-serving-cert\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.884651 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.884571    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-config\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.884651 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.884610    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-serving-cert\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.884651 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.884635    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-oauth-config\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.884774 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.884677    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6jhx\" (UniqueName: \"kubernetes.io/projected/48195c89-8e32-4f95-a972-e92b1ce7ef9d-kube-api-access-w6jhx\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.885288 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.885268    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-trusted-ca-bundle\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.885396 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.885295    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-oauth-serving-cert\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.885396 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.885295    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-service-ca\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.885396 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.885366    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-config\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.887034 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.887015    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-oauth-config\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.887292 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.887272    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-serving-cert\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.893645 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.893618    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6jhx\" (UniqueName: \"kubernetes.io/projected/48195c89-8e32-4f95-a972-e92b1ce7ef9d-kube-api-access-w6jhx\") pod \"console-6977d9d77d-4wd9l\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") " pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:22.986538 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:22.986479    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:23.103008 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:23.102887    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6977d9d77d-4wd9l"]
May 21 16:35:23.105397 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:35:23.105370    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48195c89_8e32_4f95_a972_e92b1ce7ef9d.slice/crio-dfe3efc972095f6a5116936f27c65e13b3a0f4da69c40c09d744e69cf2bda880 WatchSource:0}: Error finding container dfe3efc972095f6a5116936f27c65e13b3a0f4da69c40c09d744e69cf2bda880: Status 404 returned error can't find the container with id dfe3efc972095f6a5116936f27c65e13b3a0f4da69c40c09d744e69cf2bda880
May 21 16:35:23.998557 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:23.998521    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6977d9d77d-4wd9l" event={"ID":"48195c89-8e32-4f95-a972-e92b1ce7ef9d","Type":"ContainerStarted","Data":"dfe3efc972095f6a5116936f27c65e13b3a0f4da69c40c09d744e69cf2bda880"}
May 21 16:35:26.005135 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:26.005053    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6977d9d77d-4wd9l" event={"ID":"48195c89-8e32-4f95-a972-e92b1ce7ef9d","Type":"ContainerStarted","Data":"ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec"}
May 21 16:35:26.022365 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:26.022319    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6977d9d77d-4wd9l" podStartSLOduration=1.496417445 podStartE2EDuration="4.022305952s" podCreationTimestamp="2026-05-21 16:35:22 +0000 UTC" firstStartedPulling="2026-05-21 16:35:23.107170308 +0000 UTC m=+213.270902922" lastFinishedPulling="2026-05-21 16:35:25.633058811 +0000 UTC m=+215.796791429" observedRunningTime="2026-05-21 16:35:26.021239259 +0000 UTC m=+216.184971894" watchObservedRunningTime="2026-05-21 16:35:26.022305952 +0000 UTC m=+216.186038588"
May 21 16:35:32.986607 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:32.986575    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:32.986607 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:32.986610    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:32.991140 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:32.991119    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:35:33.026141 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:35:33.026119    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:36:02.067598 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:02.067561    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:36:02.069786 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:02.069766    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c46b8c-6c40-47ce-8dc3-a46c30350906-metrics-certs\") pod \"network-metrics-daemon-kc2cf\" (UID: \"02c46b8c-6c40-47ce-8dc3-a46c30350906\") " pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:36:02.319896 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:02.319827    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tq9vg\""
May 21 16:36:02.327847 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:02.327833    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc2cf"
May 21 16:36:02.446814 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:02.446795    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kc2cf"]
May 21 16:36:02.449329 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:36:02.449301    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c46b8c_6c40_47ce_8dc3_a46c30350906.slice/crio-6622739939ba965189618f8839fef60b305a96487fbc94988c1fa0b91326632d WatchSource:0}: Error finding container 6622739939ba965189618f8839fef60b305a96487fbc94988c1fa0b91326632d: Status 404 returned error can't find the container with id 6622739939ba965189618f8839fef60b305a96487fbc94988c1fa0b91326632d
May 21 16:36:03.102547 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:03.102512    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kc2cf" event={"ID":"02c46b8c-6c40-47ce-8dc3-a46c30350906","Type":"ContainerStarted","Data":"6622739939ba965189618f8839fef60b305a96487fbc94988c1fa0b91326632d"}
May 21 16:36:04.107182 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:04.107143    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kc2cf" event={"ID":"02c46b8c-6c40-47ce-8dc3-a46c30350906","Type":"ContainerStarted","Data":"7f73d4ca8a794e74ca6ffa4148b1ad2b15c4a0f2512f724981d6c6a1f0105248"}
May 21 16:36:04.107182 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:04.107181    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kc2cf" event={"ID":"02c46b8c-6c40-47ce-8dc3-a46c30350906","Type":"ContainerStarted","Data":"04dea0349ddf73f3a7b066ead0d6f8bdc6b64c76677cd4f46199ee3721b73cb1"}
May 21 16:36:04.123066 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:04.123014    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kc2cf" podStartSLOduration=253.252078015 podStartE2EDuration="4m14.122996633s" podCreationTimestamp="2026-05-21 16:31:50 +0000 UTC" firstStartedPulling="2026-05-21 16:36:02.451255372 +0000 UTC m=+252.614987988" lastFinishedPulling="2026-05-21 16:36:03.322173993 +0000 UTC m=+253.485906606" observedRunningTime="2026-05-21 16:36:04.122215393 +0000 UTC m=+254.285948028" watchObservedRunningTime="2026-05-21 16:36:04.122996633 +0000 UTC m=+254.286729269"
May 21 16:36:35.557786 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:35.557746    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6977d9d77d-4wd9l"]
May 21 16:36:41.741356 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.741320    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-r5j8w"]
May 21 16:36:41.743049 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.743034    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.746276 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.746256    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 16:36:41.750498 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.750477    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5j8w"]
May 21 16:36:41.821690 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.821661    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f65c605-86d8-4470-9f2c-9e982dc8ef40-original-pull-secret\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.821840 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.821723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f65c605-86d8-4470-9f2c-9e982dc8ef40-kubelet-config\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.821840 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.821762    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f65c605-86d8-4470-9f2c-9e982dc8ef40-dbus\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.922288 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.922260    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f65c605-86d8-4470-9f2c-9e982dc8ef40-kubelet-config\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.922387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.922295    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f65c605-86d8-4470-9f2c-9e982dc8ef40-dbus\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.922387 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.922323    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f65c605-86d8-4470-9f2c-9e982dc8ef40-original-pull-secret\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.922494 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.922383    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f65c605-86d8-4470-9f2c-9e982dc8ef40-kubelet-config\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.922533 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.922493    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f65c605-86d8-4470-9f2c-9e982dc8ef40-dbus\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:41.924576 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:41.924558    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f65c605-86d8-4470-9f2c-9e982dc8ef40-original-pull-secret\") pod \"global-pull-secret-syncer-r5j8w\" (UID: \"4f65c605-86d8-4470-9f2c-9e982dc8ef40\") " pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:42.052354 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:42.052333    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5j8w"
May 21 16:36:42.166196 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:42.166162    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5j8w"]
May 21 16:36:42.168921 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:36:42.168895    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f65c605_86d8_4470_9f2c_9e982dc8ef40.slice/crio-9fc4b34d00d4fb3ae0311b4e54023e79d05f794d779f99daaf17113502aaf5c2 WatchSource:0}: Error finding container 9fc4b34d00d4fb3ae0311b4e54023e79d05f794d779f99daaf17113502aaf5c2: Status 404 returned error can't find the container with id 9fc4b34d00d4fb3ae0311b4e54023e79d05f794d779f99daaf17113502aaf5c2
May 21 16:36:42.202186 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:42.202161    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5j8w" event={"ID":"4f65c605-86d8-4470-9f2c-9e982dc8ef40","Type":"ContainerStarted","Data":"9fc4b34d00d4fb3ae0311b4e54023e79d05f794d779f99daaf17113502aaf5c2"}
May 21 16:36:47.215536 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:47.215497    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5j8w" event={"ID":"4f65c605-86d8-4470-9f2c-9e982dc8ef40","Type":"ContainerStarted","Data":"c592c16dae3395e0c57d1e91f87726a6afc6bef6238d17928a3dd16ac26ac408"}
May 21 16:36:47.230188 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:47.230143    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r5j8w" podStartSLOduration=1.7341424220000001 podStartE2EDuration="6.230131672s" podCreationTimestamp="2026-05-21 16:36:41 +0000 UTC" firstStartedPulling="2026-05-21 16:36:42.170558585 +0000 UTC m=+292.334291201" lastFinishedPulling="2026-05-21 16:36:46.666547837 +0000 UTC m=+296.830280451" observedRunningTime="2026-05-21 16:36:47.229166109 +0000 UTC m=+297.392898745" watchObservedRunningTime="2026-05-21 16:36:47.230131672 +0000 UTC m=+297.393864306"
May 21 16:36:50.236373 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:36:50.236348    2567 kubelet.go:1628] "Image garbage collection succeeded"
May 21 16:37:00.576264 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.576206    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6977d9d77d-4wd9l" podUID="48195c89-8e32-4f95-a972-e92b1ce7ef9d" containerName="console" containerID="cri-o://ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec" gracePeriod=15
May 21 16:37:00.813065 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.813043    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6977d9d77d-4wd9l_48195c89-8e32-4f95-a972-e92b1ce7ef9d/console/0.log"
May 21 16:37:00.813161 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.813112    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:37:00.855477 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.855408    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6jhx\" (UniqueName: \"kubernetes.io/projected/48195c89-8e32-4f95-a972-e92b1ce7ef9d-kube-api-access-w6jhx\") pod \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") "
May 21 16:37:00.855477 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.855447    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-service-ca\") pod \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") "
May 21 16:37:00.855641 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.855497    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-oauth-config\") pod \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") "
May 21 16:37:00.855641 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.855530    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-trusted-ca-bundle\") pod \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") "
May 21 16:37:00.855641 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.855563    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-oauth-serving-cert\") pod \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") "
May 21 16:37:00.855641 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.855577    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-serving-cert\") pod \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") "
May 21 16:37:00.855641 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.855597    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-config\") pod \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\" (UID: \"48195c89-8e32-4f95-a972-e92b1ce7ef9d\") "
May 21 16:37:00.856039 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.856005    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "48195c89-8e32-4f95-a972-e92b1ce7ef9d" (UID: "48195c89-8e32-4f95-a972-e92b1ce7ef9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:37:00.856167 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.856091    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "48195c89-8e32-4f95-a972-e92b1ce7ef9d" (UID: "48195c89-8e32-4f95-a972-e92b1ce7ef9d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:37:00.856167 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.856118    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-config" (OuterVolumeSpecName: "console-config") pod "48195c89-8e32-4f95-a972-e92b1ce7ef9d" (UID: "48195c89-8e32-4f95-a972-e92b1ce7ef9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:37:00.856167 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.856137    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48195c89-8e32-4f95-a972-e92b1ce7ef9d" (UID: "48195c89-8e32-4f95-a972-e92b1ce7ef9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:37:00.857708 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.857686    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48195c89-8e32-4f95-a972-e92b1ce7ef9d-kube-api-access-w6jhx" (OuterVolumeSpecName: "kube-api-access-w6jhx") pod "48195c89-8e32-4f95-a972-e92b1ce7ef9d" (UID: "48195c89-8e32-4f95-a972-e92b1ce7ef9d"). InnerVolumeSpecName "kube-api-access-w6jhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:37:00.857791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.857700    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48195c89-8e32-4f95-a972-e92b1ce7ef9d" (UID: "48195c89-8e32-4f95-a972-e92b1ce7ef9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 16:37:00.857791 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.857750    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48195c89-8e32-4f95-a972-e92b1ce7ef9d" (UID: "48195c89-8e32-4f95-a972-e92b1ce7ef9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 16:37:00.956772 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.956752    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-trusted-ca-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:37:00.956772 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.956772    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-oauth-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:37:00.956883 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.956781    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:37:00.956883 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.956791    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:37:00.956883 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.956800    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6jhx\" (UniqueName: \"kubernetes.io/projected/48195c89-8e32-4f95-a972-e92b1ce7ef9d-kube-api-access-w6jhx\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:37:00.956883 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.956810    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48195c89-8e32-4f95-a972-e92b1ce7ef9d-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:37:00.956883 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:00.956818    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48195c89-8e32-4f95-a972-e92b1ce7ef9d-console-oauth-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:37:01.251351 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.251294    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6977d9d77d-4wd9l_48195c89-8e32-4f95-a972-e92b1ce7ef9d/console/0.log"
May 21 16:37:01.251351 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.251331    2567 generic.go:358] "Generic (PLEG): container finished" podID="48195c89-8e32-4f95-a972-e92b1ce7ef9d" containerID="ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec" exitCode=2
May 21 16:37:01.251499 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.251363    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6977d9d77d-4wd9l" event={"ID":"48195c89-8e32-4f95-a972-e92b1ce7ef9d","Type":"ContainerDied","Data":"ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec"}
May 21 16:37:01.251499 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.251398    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6977d9d77d-4wd9l"
May 21 16:37:01.251499 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.251410    2567 scope.go:117] "RemoveContainer" containerID="ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec"
May 21 16:37:01.251499 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.251400    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6977d9d77d-4wd9l" event={"ID":"48195c89-8e32-4f95-a972-e92b1ce7ef9d","Type":"ContainerDied","Data":"dfe3efc972095f6a5116936f27c65e13b3a0f4da69c40c09d744e69cf2bda880"}
May 21 16:37:01.259859 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.259843    2567 scope.go:117] "RemoveContainer" containerID="ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec"
May 21 16:37:01.260117 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:37:01.260099    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec\": container with ID starting with ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec not found: ID does not exist" containerID="ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec"
May 21 16:37:01.260164 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.260126    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec"} err="failed to get container status \"ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec\": rpc error: code = NotFound desc = could not find container \"ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec\": container with ID starting with ffaffe898ade929daad9256448f422c08ec6432ef1a6a8dfb74d1d8ef8633fec not found: ID does not exist"
May 21 16:37:01.271065 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.271041    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6977d9d77d-4wd9l"]
May 21 16:37:01.274004 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:01.273984    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6977d9d77d-4wd9l"]
May 21 16:37:02.319382 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:02.319350    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48195c89-8e32-4f95-a972-e92b1ce7ef9d" path="/var/lib/kubelet/pods/48195c89-8e32-4f95-a972-e92b1ce7ef9d/volumes"
May 21 16:37:50.301856 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.301821    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"]
May 21 16:37:50.302209 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.302138    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48195c89-8e32-4f95-a972-e92b1ce7ef9d" containerName="console"
May 21 16:37:50.302209 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.302168    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="48195c89-8e32-4f95-a972-e92b1ce7ef9d" containerName="console"
May 21 16:37:50.302296 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.302218    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="48195c89-8e32-4f95-a972-e92b1ce7ef9d" containerName="console"
May 21 16:37:50.303788 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.303771    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.306069 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.306048    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dtq6q\""
May 21 16:37:50.306192 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.306083    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 16:37:50.307025 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.307006    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 16:37:50.311896 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.311875    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"]
May 21 16:37:50.404567 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.404521    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ww5c\" (UniqueName: \"kubernetes.io/projected/bc7ddd25-e02d-43ef-add2-89026b7021b6-kube-api-access-9ww5c\") pod \"openshift-lws-operator-bfc7f696d-75krr\" (UID: \"bc7ddd25-e02d-43ef-add2-89026b7021b6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.404761 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.404585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7ddd25-e02d-43ef-add2-89026b7021b6-tmp\") pod \"openshift-lws-operator-bfc7f696d-75krr\" (UID: \"bc7ddd25-e02d-43ef-add2-89026b7021b6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.505065 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.504984    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7ddd25-e02d-43ef-add2-89026b7021b6-tmp\") pod \"openshift-lws-operator-bfc7f696d-75krr\" (UID: \"bc7ddd25-e02d-43ef-add2-89026b7021b6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.505065 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.505055    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ww5c\" (UniqueName: \"kubernetes.io/projected/bc7ddd25-e02d-43ef-add2-89026b7021b6-kube-api-access-9ww5c\") pod \"openshift-lws-operator-bfc7f696d-75krr\" (UID: \"bc7ddd25-e02d-43ef-add2-89026b7021b6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.505415 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.505393    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7ddd25-e02d-43ef-add2-89026b7021b6-tmp\") pod \"openshift-lws-operator-bfc7f696d-75krr\" (UID: \"bc7ddd25-e02d-43ef-add2-89026b7021b6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.512771 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.512739    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ww5c\" (UniqueName: \"kubernetes.io/projected/bc7ddd25-e02d-43ef-add2-89026b7021b6-kube-api-access-9ww5c\") pod \"openshift-lws-operator-bfc7f696d-75krr\" (UID: \"bc7ddd25-e02d-43ef-add2-89026b7021b6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.615968 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.615938    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"
May 21 16:37:50.733895 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.733866    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr"]
May 21 16:37:50.736824 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:37:50.736795    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc7ddd25_e02d_43ef_add2_89026b7021b6.slice/crio-6edd291280d906c42128c9a1e16abc9cde266c1a1e722c3c84e9b706aa92877f WatchSource:0}: Error finding container 6edd291280d906c42128c9a1e16abc9cde266c1a1e722c3c84e9b706aa92877f: Status 404 returned error can't find the container with id 6edd291280d906c42128c9a1e16abc9cde266c1a1e722c3c84e9b706aa92877f
May 21 16:37:50.738155 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:50.738137    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:37:51.373953 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:51.373918    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr" event={"ID":"bc7ddd25-e02d-43ef-add2-89026b7021b6","Type":"ContainerStarted","Data":"6edd291280d906c42128c9a1e16abc9cde266c1a1e722c3c84e9b706aa92877f"}
May 21 16:37:55.385198 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:55.385158    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr" event={"ID":"bc7ddd25-e02d-43ef-add2-89026b7021b6","Type":"ContainerStarted","Data":"3ef67aeac96d93d5b37b7b21eccb2c5dea5067cbd5148a8700a98480aecab7ed"}
May 21 16:37:55.400742 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:37:55.400690    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-75krr" podStartSLOduration=1.730559372 podStartE2EDuration="5.400675588s" podCreationTimestamp="2026-05-21 16:37:50 +0000 UTC" firstStartedPulling="2026-05-21 16:37:50.738275905 +0000 UTC m=+360.902008518" lastFinishedPulling="2026-05-21 16:37:54.408392111 +0000 UTC m=+364.572124734" observedRunningTime="2026-05-21 16:37:55.400623563 +0000 UTC m=+365.564356198" watchObservedRunningTime="2026-05-21 16:37:55.400675588 +0000 UTC m=+365.564408206"
May 21 16:38:10.230264 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.230224    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"]
May 21 16:38:10.232167 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.232147    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.234778 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.234750    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 16:38:10.234962 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.234819    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 16:38:10.235037 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.235020    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wnrl7\""
May 21 16:38:10.235086 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.235045    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 16:38:10.235129 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.235048    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 16:38:10.244886 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.244856    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"]
May 21 16:38:10.360317 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.360288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f16b16db-ba75-4d6f-8ac3-1583d63c934e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.360539 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.360329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f16b16db-ba75-4d6f-8ac3-1583d63c934e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.360539 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.360382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px8zt\" (UniqueName: \"kubernetes.io/projected/f16b16db-ba75-4d6f-8ac3-1583d63c934e-kube-api-access-px8zt\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.461563 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.461527    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f16b16db-ba75-4d6f-8ac3-1583d63c934e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.461739 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.461567    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-px8zt\" (UniqueName: \"kubernetes.io/projected/f16b16db-ba75-4d6f-8ac3-1583d63c934e-kube-api-access-px8zt\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.461739 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.461657    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f16b16db-ba75-4d6f-8ac3-1583d63c934e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.463988 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.463959    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f16b16db-ba75-4d6f-8ac3-1583d63c934e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.464113 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.463989    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f16b16db-ba75-4d6f-8ac3-1583d63c934e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.471174 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.471144    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px8zt\" (UniqueName: \"kubernetes.io/projected/f16b16db-ba75-4d6f-8ac3-1583d63c934e-kube-api-access-px8zt\") pod \"opendatahub-operator-controller-manager-6f6f66c9f4-9zks5\" (UID: \"f16b16db-ba75-4d6f-8ac3-1583d63c934e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.542985 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.542959    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:10.663626 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:10.663576    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"]
May 21 16:38:10.667213 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:38:10.667185    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16b16db_ba75_4d6f_8ac3_1583d63c934e.slice/crio-4c81ff1b0fbcee7b0f64a5b0387bdb27cbb9f399f70be7c2e233d4f0f0135bb6 WatchSource:0}: Error finding container 4c81ff1b0fbcee7b0f64a5b0387bdb27cbb9f399f70be7c2e233d4f0f0135bb6: Status 404 returned error can't find the container with id 4c81ff1b0fbcee7b0f64a5b0387bdb27cbb9f399f70be7c2e233d4f0f0135bb6
May 21 16:38:11.427147 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:11.427110    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5" event={"ID":"f16b16db-ba75-4d6f-8ac3-1583d63c934e","Type":"ContainerStarted","Data":"4c81ff1b0fbcee7b0f64a5b0387bdb27cbb9f399f70be7c2e233d4f0f0135bb6"}
May 21 16:38:13.436616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:13.436582    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5" event={"ID":"f16b16db-ba75-4d6f-8ac3-1583d63c934e","Type":"ContainerStarted","Data":"47046d4428128754953ba6971ac8f5274778352038bd8d95b01978eddb6b6b9d"}
May 21 16:38:13.437051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:13.436740    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:13.458402 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:13.458353    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5" podStartSLOduration=0.89325161 podStartE2EDuration="3.458340942s" podCreationTimestamp="2026-05-21 16:38:10 +0000 UTC" firstStartedPulling="2026-05-21 16:38:10.668921267 +0000 UTC m=+380.832653881" lastFinishedPulling="2026-05-21 16:38:13.234010597 +0000 UTC m=+383.397743213" observedRunningTime="2026-05-21 16:38:13.457285414 +0000 UTC m=+383.621018051" watchObservedRunningTime="2026-05-21 16:38:13.458340942 +0000 UTC m=+383.622073577"
May 21 16:38:24.442222 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:24.442190    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f66c9f4-9zks5"
May 21 16:38:28.153768 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.153734    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"]
May 21 16:38:28.155764 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.155746    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.157931 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.157912    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 16:38:28.158172 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.158151    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 16:38:28.159179 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.159158    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 16:38:28.159291 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.159218    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8z9q4\""
May 21 16:38:28.159472 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.159428    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 16:38:28.167552 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.167527    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"]
May 21 16:38:28.191833 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.191811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11381953-0a7f-48c7-bb79-580e73346559-tmp\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.191966 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.191858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gklp\" (UniqueName: \"kubernetes.io/projected/11381953-0a7f-48c7-bb79-580e73346559-kube-api-access-5gklp\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.191966 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.191935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11381953-0a7f-48c7-bb79-580e73346559-tls-certs\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.292265 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.292233    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11381953-0a7f-48c7-bb79-580e73346559-tmp\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.292407 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.292310    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gklp\" (UniqueName: \"kubernetes.io/projected/11381953-0a7f-48c7-bb79-580e73346559-kube-api-access-5gklp\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.292407 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.292344    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11381953-0a7f-48c7-bb79-580e73346559-tls-certs\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.294437 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.294410    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11381953-0a7f-48c7-bb79-580e73346559-tmp\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.294620 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.294604    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11381953-0a7f-48c7-bb79-580e73346559-tls-certs\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.300215 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.300190    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gklp\" (UniqueName: \"kubernetes.io/projected/11381953-0a7f-48c7-bb79-580e73346559-kube-api-access-5gklp\") pod \"kube-auth-proxy-5df99877bf-tr28z\" (UID: \"11381953-0a7f-48c7-bb79-580e73346559\") " pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.465245 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.465143    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"
May 21 16:38:28.591515 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:28.591491    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df99877bf-tr28z"]
May 21 16:38:28.594149 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:38:28.594118    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11381953_0a7f_48c7_bb79_580e73346559.slice/crio-6d19ee3f508e7eea19daaf3238dfdcc6282dda207d82622e802972bd096b6155 WatchSource:0}: Error finding container 6d19ee3f508e7eea19daaf3238dfdcc6282dda207d82622e802972bd096b6155: Status 404 returned error can't find the container with id 6d19ee3f508e7eea19daaf3238dfdcc6282dda207d82622e802972bd096b6155
May 21 16:38:29.480049 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:29.480000    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z" event={"ID":"11381953-0a7f-48c7-bb79-580e73346559","Type":"ContainerStarted","Data":"6d19ee3f508e7eea19daaf3238dfdcc6282dda207d82622e802972bd096b6155"}
May 21 16:38:32.453916 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.453881    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-v5w5q"]
May 21 16:38:32.456159 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.456138    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:32.458550 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.458530    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xtpcq\""
May 21 16:38:32.458658 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.458622    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 16:38:32.464343 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.464317    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-v5w5q"]
May 21 16:38:32.489425 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.489390    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z" event={"ID":"11381953-0a7f-48c7-bb79-580e73346559","Type":"ContainerStarted","Data":"c5d402f398e9b481cb0d7c35c5e01b2becaccd7dc45211bc6f05ce54cb692537"}
May 21 16:38:32.504645 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.504598    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5df99877bf-tr28z" podStartSLOduration=1.541668258 podStartE2EDuration="4.504584799s" podCreationTimestamp="2026-05-21 16:38:28 +0000 UTC" firstStartedPulling="2026-05-21 16:38:28.595834599 +0000 UTC m=+398.759567212" lastFinishedPulling="2026-05-21 16:38:31.558751137 +0000 UTC m=+401.722483753" observedRunningTime="2026-05-21 16:38:32.502998844 +0000 UTC m=+402.666731503" watchObservedRunningTime="2026-05-21 16:38:32.504584799 +0000 UTC m=+402.668317434"
May 21 16:38:32.529522 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.529484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c01f402f-b947-435a-9587-f57c7e762bed-cert\") pod \"odh-model-controller-858dbf95b8-v5w5q\" (UID: \"c01f402f-b947-435a-9587-f57c7e762bed\") " pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:32.529696 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.529536    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8nlx\" (UniqueName: \"kubernetes.io/projected/c01f402f-b947-435a-9587-f57c7e762bed-kube-api-access-f8nlx\") pod \"odh-model-controller-858dbf95b8-v5w5q\" (UID: \"c01f402f-b947-435a-9587-f57c7e762bed\") " pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:32.630725 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.630691    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c01f402f-b947-435a-9587-f57c7e762bed-cert\") pod \"odh-model-controller-858dbf95b8-v5w5q\" (UID: \"c01f402f-b947-435a-9587-f57c7e762bed\") " pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:32.630725 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.630721    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8nlx\" (UniqueName: \"kubernetes.io/projected/c01f402f-b947-435a-9587-f57c7e762bed-kube-api-access-f8nlx\") pod \"odh-model-controller-858dbf95b8-v5w5q\" (UID: \"c01f402f-b947-435a-9587-f57c7e762bed\") " pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:32.630948 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:38:32.630834    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 16:38:32.630948 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:38:32.630894    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c01f402f-b947-435a-9587-f57c7e762bed-cert podName:c01f402f-b947-435a-9587-f57c7e762bed nodeName:}" failed. No retries permitted until 2026-05-21 16:38:33.130877366 +0000 UTC m=+403.294609986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c01f402f-b947-435a-9587-f57c7e762bed-cert") pod "odh-model-controller-858dbf95b8-v5w5q" (UID: "c01f402f-b947-435a-9587-f57c7e762bed") : secret "odh-model-controller-webhook-cert" not found
May 21 16:38:32.639178 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:32.639150    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8nlx\" (UniqueName: \"kubernetes.io/projected/c01f402f-b947-435a-9587-f57c7e762bed-kube-api-access-f8nlx\") pod \"odh-model-controller-858dbf95b8-v5w5q\" (UID: \"c01f402f-b947-435a-9587-f57c7e762bed\") " pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:33.134812 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:33.134769    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c01f402f-b947-435a-9587-f57c7e762bed-cert\") pod \"odh-model-controller-858dbf95b8-v5w5q\" (UID: \"c01f402f-b947-435a-9587-f57c7e762bed\") " pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:33.137194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:33.137167    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c01f402f-b947-435a-9587-f57c7e762bed-cert\") pod \"odh-model-controller-858dbf95b8-v5w5q\" (UID: \"c01f402f-b947-435a-9587-f57c7e762bed\") " pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:33.367151 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:33.367117    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:33.490302 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:33.490275    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-v5w5q"]
May 21 16:38:33.492982 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:38:33.492956    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01f402f_b947_435a_9587_f57c7e762bed.slice/crio-7729b8f60bdd48e18595aec60646b6b6eb9fb7a425ba0d530fdb8bbe091ed082 WatchSource:0}: Error finding container 7729b8f60bdd48e18595aec60646b6b6eb9fb7a425ba0d530fdb8bbe091ed082: Status 404 returned error can't find the container with id 7729b8f60bdd48e18595aec60646b6b6eb9fb7a425ba0d530fdb8bbe091ed082
May 21 16:38:34.496919 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:34.496869    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" event={"ID":"c01f402f-b947-435a-9587-f57c7e762bed","Type":"ContainerStarted","Data":"7729b8f60bdd48e18595aec60646b6b6eb9fb7a425ba0d530fdb8bbe091ed082"}
May 21 16:38:36.504335 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:36.504237    2567 generic.go:358] "Generic (PLEG): container finished" podID="c01f402f-b947-435a-9587-f57c7e762bed" containerID="e7361cc1d29ef53ec537a9ad52cc8db6bb0ad11b1527cd906d3e8c1859fc0c8e" exitCode=1
May 21 16:38:36.504335 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:36.504313    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" event={"ID":"c01f402f-b947-435a-9587-f57c7e762bed","Type":"ContainerDied","Data":"e7361cc1d29ef53ec537a9ad52cc8db6bb0ad11b1527cd906d3e8c1859fc0c8e"}
May 21 16:38:36.504847 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:36.504614    2567 scope.go:117] "RemoveContainer" containerID="e7361cc1d29ef53ec537a9ad52cc8db6bb0ad11b1527cd906d3e8c1859fc0c8e"
May 21 16:38:37.508154 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:37.508121    2567 generic.go:358] "Generic (PLEG): container finished" podID="c01f402f-b947-435a-9587-f57c7e762bed" containerID="8196198b01492e27b28a22efaa62b094de31ec58b7ff9f3fec001eb4dd318411" exitCode=1
May 21 16:38:37.508693 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:37.508207    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" event={"ID":"c01f402f-b947-435a-9587-f57c7e762bed","Type":"ContainerDied","Data":"8196198b01492e27b28a22efaa62b094de31ec58b7ff9f3fec001eb4dd318411"}
May 21 16:38:37.508693 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:37.508257    2567 scope.go:117] "RemoveContainer" containerID="e7361cc1d29ef53ec537a9ad52cc8db6bb0ad11b1527cd906d3e8c1859fc0c8e"
May 21 16:38:37.508693 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:37.508505    2567 scope.go:117] "RemoveContainer" containerID="8196198b01492e27b28a22efaa62b094de31ec58b7ff9f3fec001eb4dd318411"
May 21 16:38:37.508851 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:38:37.508738    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-v5w5q_opendatahub(c01f402f-b947-435a-9587-f57c7e762bed)\"" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" podUID="c01f402f-b947-435a-9587-f57c7e762bed"
May 21 16:38:38.372176 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.372139    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-xmh77"]
May 21 16:38:38.375026 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.375007    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:38.377537 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.377375    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lmvmq\""
May 21 16:38:38.377537 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.377387    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 16:38:38.383602 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.383580    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-xmh77"]
May 21 16:38:38.476160 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.476123    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61873eef-3266-4a00-a948-4500bdb9ce1d-cert\") pod \"kserve-controller-manager-856948b99f-xmh77\" (UID: \"61873eef-3266-4a00-a948-4500bdb9ce1d\") " pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:38.476352 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.476172    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ktnd\" (UniqueName: \"kubernetes.io/projected/61873eef-3266-4a00-a948-4500bdb9ce1d-kube-api-access-7ktnd\") pod \"kserve-controller-manager-856948b99f-xmh77\" (UID: \"61873eef-3266-4a00-a948-4500bdb9ce1d\") " pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:38.514210 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.514180    2567 scope.go:117] "RemoveContainer" containerID="8196198b01492e27b28a22efaa62b094de31ec58b7ff9f3fec001eb4dd318411"
May 21 16:38:38.514714 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:38:38.514498    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-v5w5q_opendatahub(c01f402f-b947-435a-9587-f57c7e762bed)\"" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" podUID="c01f402f-b947-435a-9587-f57c7e762bed"
May 21 16:38:38.577277 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.577236    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61873eef-3266-4a00-a948-4500bdb9ce1d-cert\") pod \"kserve-controller-manager-856948b99f-xmh77\" (UID: \"61873eef-3266-4a00-a948-4500bdb9ce1d\") " pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:38.577605 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.577298    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ktnd\" (UniqueName: \"kubernetes.io/projected/61873eef-3266-4a00-a948-4500bdb9ce1d-kube-api-access-7ktnd\") pod \"kserve-controller-manager-856948b99f-xmh77\" (UID: \"61873eef-3266-4a00-a948-4500bdb9ce1d\") " pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:38.577605 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:38:38.577395    2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 16:38:38.577605 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:38:38.577492    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61873eef-3266-4a00-a948-4500bdb9ce1d-cert podName:61873eef-3266-4a00-a948-4500bdb9ce1d nodeName:}" failed. No retries permitted until 2026-05-21 16:38:39.077469286 +0000 UTC m=+409.241201925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61873eef-3266-4a00-a948-4500bdb9ce1d-cert") pod "kserve-controller-manager-856948b99f-xmh77" (UID: "61873eef-3266-4a00-a948-4500bdb9ce1d") : secret "kserve-webhook-server-cert" not found
May 21 16:38:38.586422 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:38.586396    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ktnd\" (UniqueName: \"kubernetes.io/projected/61873eef-3266-4a00-a948-4500bdb9ce1d-kube-api-access-7ktnd\") pod \"kserve-controller-manager-856948b99f-xmh77\" (UID: \"61873eef-3266-4a00-a948-4500bdb9ce1d\") " pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:39.081717 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:39.081669    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61873eef-3266-4a00-a948-4500bdb9ce1d-cert\") pod \"kserve-controller-manager-856948b99f-xmh77\" (UID: \"61873eef-3266-4a00-a948-4500bdb9ce1d\") " pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:39.084347 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:39.084304    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61873eef-3266-4a00-a948-4500bdb9ce1d-cert\") pod \"kserve-controller-manager-856948b99f-xmh77\" (UID: \"61873eef-3266-4a00-a948-4500bdb9ce1d\") " pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:39.286563 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:39.286524    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:39.405121 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:39.405090    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-xmh77"]
May 21 16:38:39.408212 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:38:39.408182    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61873eef_3266_4a00_a948_4500bdb9ce1d.slice/crio-e37c73104e48d893b110e6b4229ea5f183e2df121160889ee43a2bb0ab0cbfa9 WatchSource:0}: Error finding container e37c73104e48d893b110e6b4229ea5f183e2df121160889ee43a2bb0ab0cbfa9: Status 404 returned error can't find the container with id e37c73104e48d893b110e6b4229ea5f183e2df121160889ee43a2bb0ab0cbfa9
May 21 16:38:39.518281 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:39.518232    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-xmh77" event={"ID":"61873eef-3266-4a00-a948-4500bdb9ce1d","Type":"ContainerStarted","Data":"e37c73104e48d893b110e6b4229ea5f183e2df121160889ee43a2bb0ab0cbfa9"}
May 21 16:38:43.041611 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.041577    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"]
May 21 16:38:43.049823 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.049799    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.052357 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.052335    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-x4q2k\""
May 21 16:38:43.052492 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.052378    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 16:38:43.052639 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.052619    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 16:38:43.060353 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.060330    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"]
May 21 16:38:43.118827 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.118790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znld2\" (UniqueName: \"kubernetes.io/projected/2745b875-ff83-4681-a251-9ab5367884fa-kube-api-access-znld2\") pod \"servicemesh-operator3-55f49c5f94-h6b9m\" (UID: \"2745b875-ff83-4681-a251-9ab5367884fa\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.119014 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.118866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2745b875-ff83-4681-a251-9ab5367884fa-operator-config\") pod \"servicemesh-operator3-55f49c5f94-h6b9m\" (UID: \"2745b875-ff83-4681-a251-9ab5367884fa\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.219503 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.219344    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znld2\" (UniqueName: \"kubernetes.io/projected/2745b875-ff83-4681-a251-9ab5367884fa-kube-api-access-znld2\") pod \"servicemesh-operator3-55f49c5f94-h6b9m\" (UID: \"2745b875-ff83-4681-a251-9ab5367884fa\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.219690 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.219523    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2745b875-ff83-4681-a251-9ab5367884fa-operator-config\") pod \"servicemesh-operator3-55f49c5f94-h6b9m\" (UID: \"2745b875-ff83-4681-a251-9ab5367884fa\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.222380 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.222350    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2745b875-ff83-4681-a251-9ab5367884fa-operator-config\") pod \"servicemesh-operator3-55f49c5f94-h6b9m\" (UID: \"2745b875-ff83-4681-a251-9ab5367884fa\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.229728 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.229704    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znld2\" (UniqueName: \"kubernetes.io/projected/2745b875-ff83-4681-a251-9ab5367884fa-kube-api-access-znld2\") pod \"servicemesh-operator3-55f49c5f94-h6b9m\" (UID: \"2745b875-ff83-4681-a251-9ab5367884fa\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.359219 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.359183    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:43.368017 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.367992    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:43.368429 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.368415    2567 scope.go:117] "RemoveContainer" containerID="8196198b01492e27b28a22efaa62b094de31ec58b7ff9f3fec001eb4dd318411"
May 21 16:38:43.368614 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:38:43.368597    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-v5w5q_opendatahub(c01f402f-b947-435a-9587-f57c7e762bed)\"" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" podUID="c01f402f-b947-435a-9587-f57c7e762bed"
May 21 16:38:43.518536 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.518291    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"]
May 21 16:38:43.521654 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:38:43.521620    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2745b875_ff83_4681_a251_9ab5367884fa.slice/crio-5772799ef985c1e95965ace6ec65cde03450596941f0eefa4f11f560fe1c4b06 WatchSource:0}: Error finding container 5772799ef985c1e95965ace6ec65cde03450596941f0eefa4f11f560fe1c4b06: Status 404 returned error can't find the container with id 5772799ef985c1e95965ace6ec65cde03450596941f0eefa4f11f560fe1c4b06
May 21 16:38:43.531851 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.531825    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-xmh77" event={"ID":"61873eef-3266-4a00-a948-4500bdb9ce1d","Type":"ContainerStarted","Data":"19c658e5a8027e6fdc39097f438fe7fdfe57ee36df2fd901024285896f7864ed"}
May 21 16:38:43.531982 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.531970    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:38:43.533015 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.532992    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m" event={"ID":"2745b875-ff83-4681-a251-9ab5367884fa","Type":"ContainerStarted","Data":"5772799ef985c1e95965ace6ec65cde03450596941f0eefa4f11f560fe1c4b06"}
May 21 16:38:43.548691 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:43.548637    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-xmh77" podStartSLOduration=2.004989898 podStartE2EDuration="5.548623153s" podCreationTimestamp="2026-05-21 16:38:38 +0000 UTC" firstStartedPulling="2026-05-21 16:38:39.409898955 +0000 UTC m=+409.573631568" lastFinishedPulling="2026-05-21 16:38:42.9535322 +0000 UTC m=+413.117264823" observedRunningTime="2026-05-21 16:38:43.547909574 +0000 UTC m=+413.711642208" watchObservedRunningTime="2026-05-21 16:38:43.548623153 +0000 UTC m=+413.712355789"
May 21 16:38:47.552472 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:47.552414    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m" event={"ID":"2745b875-ff83-4681-a251-9ab5367884fa","Type":"ContainerStarted","Data":"f9c5b5c3c9358b76cc7db507c7fe9d87c0da995528b350fc21d35b6e3297bf6f"}
May 21 16:38:47.553005 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:47.552651    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:47.573198 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:47.573134    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m" podStartSLOduration=1.427816095 podStartE2EDuration="4.573115651s" podCreationTimestamp="2026-05-21 16:38:43 +0000 UTC" firstStartedPulling="2026-05-21 16:38:43.524354315 +0000 UTC m=+413.688086931" lastFinishedPulling="2026-05-21 16:38:46.669653854 +0000 UTC m=+416.833386487" observedRunningTime="2026-05-21 16:38:47.570384834 +0000 UTC m=+417.734117468" watchObservedRunningTime="2026-05-21 16:38:47.573115651 +0000 UTC m=+417.736848286"
May 21 16:38:53.368235 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:53.368177    2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:53.368665 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:53.368612    2567 scope.go:117] "RemoveContainer" containerID="8196198b01492e27b28a22efaa62b094de31ec58b7ff9f3fec001eb4dd318411"
May 21 16:38:54.573096 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:54.573059    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" event={"ID":"c01f402f-b947-435a-9587-f57c7e762bed","Type":"ContainerStarted","Data":"c093b36f0aa1d8d10f22951f7ca2b4f36a7e7a88c9757133304212194bb5e6f2"}
May 21 16:38:54.573483 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:54.573266    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:38:54.595215 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:54.595164    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q" podStartSLOduration=2.477140276 podStartE2EDuration="22.59514857s" podCreationTimestamp="2026-05-21 16:38:32 +0000 UTC" firstStartedPulling="2026-05-21 16:38:33.494514101 +0000 UTC m=+403.658246716" lastFinishedPulling="2026-05-21 16:38:53.612522388 +0000 UTC m=+423.776255010" observedRunningTime="2026-05-21 16:38:54.593804083 +0000 UTC m=+424.757536718" watchObservedRunningTime="2026-05-21 16:38:54.59514857 +0000 UTC m=+424.758881204"
May 21 16:38:58.557501 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:58.557446    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-h6b9m"
May 21 16:38:59.057110 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.057073    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"]
May 21 16:38:59.059256 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.059237    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.061813 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.061794    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 16:38:59.061900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.061877    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-khvzr\""
May 21 16:38:59.062034 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.062015    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 16:38:59.062142 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.062015    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 16:38:59.062207 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.062167    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 16:38:59.073235 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.073209    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"]
May 21 16:38:59.153688 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.153655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.153881 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.153694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.153881 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.153720    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f10c2d-7091-46a7-96cf-ee563c4cadcc-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.153881 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.153786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8pnc\" (UniqueName: \"kubernetes.io/projected/06f10c2d-7091-46a7-96cf-ee563c4cadcc-kube-api-access-v8pnc\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.153881 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.153872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.154071 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.153908    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.154071 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.153938    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.254706 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.254674    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.254892 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.254714    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.254892 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.254734    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.254892 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.254836    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.254892 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.254886    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.255141 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.254927    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f10c2d-7091-46a7-96cf-ee563c4cadcc-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.255141 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.254966    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8pnc\" (UniqueName: \"kubernetes.io/projected/06f10c2d-7091-46a7-96cf-ee563c4cadcc-kube-api-access-v8pnc\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.255934 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.255908    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.257634 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.257593    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f10c2d-7091-46a7-96cf-ee563c4cadcc-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.257738 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.257675    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.257809 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.257788    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.258318 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.258296    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.268902 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.268875    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8pnc\" (UniqueName: \"kubernetes.io/projected/06f10c2d-7091-46a7-96cf-ee563c4cadcc-kube-api-access-v8pnc\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.269001 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.268914    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f10c2d-7091-46a7-96cf-ee563c4cadcc-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d45ct\" (UID: \"06f10c2d-7091-46a7-96cf-ee563c4cadcc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.369947 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.369839    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:38:59.517774 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.517672    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"]
May 21 16:38:59.520387 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:38:59.520358    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f10c2d_7091_46a7_96cf_ee563c4cadcc.slice/crio-cdb32767ffe337c523f9c29a8ae9427f0b32ca51ed2c75d783515ae4e376642a WatchSource:0}: Error finding container cdb32767ffe337c523f9c29a8ae9427f0b32ca51ed2c75d783515ae4e376642a: Status 404 returned error can't find the container with id cdb32767ffe337c523f9c29a8ae9427f0b32ca51ed2c75d783515ae4e376642a
May 21 16:38:59.588643 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:38:59.588608    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct" event={"ID":"06f10c2d-7091-46a7-96cf-ee563c4cadcc","Type":"ContainerStarted","Data":"cdb32767ffe337c523f9c29a8ae9427f0b32ca51ed2c75d783515ae4e376642a"}
May 21 16:39:01.903652 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:01.903606    2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
May 21 16:39:01.903919 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:01.903692    2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
May 21 16:39:02.600518 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:02.600481    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct" event={"ID":"06f10c2d-7091-46a7-96cf-ee563c4cadcc","Type":"ContainerStarted","Data":"b0ab0e99be69a6a5679fb985e7047bad0f0db7b3321b009da8aa4b36b2c250d6"}
May 21 16:39:02.600772 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:02.600749    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:39:02.602436 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:02.602407    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-d45ct container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 16:39:02.602583 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:02.602482    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct" podUID="06f10c2d-7091-46a7-96cf-ee563c4cadcc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 16:39:02.620186 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:02.620131    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct" podStartSLOduration=1.239757587 podStartE2EDuration="3.620115973s" podCreationTimestamp="2026-05-21 16:38:59 +0000 UTC" firstStartedPulling="2026-05-21 16:38:59.522930087 +0000 UTC m=+429.686662714" lastFinishedPulling="2026-05-21 16:39:01.903288471 +0000 UTC m=+432.067021100" observedRunningTime="2026-05-21 16:39:02.618059466 +0000 UTC m=+432.781792108" watchObservedRunningTime="2026-05-21 16:39:02.620115973 +0000 UTC m=+432.783848609"
May 21 16:39:03.604655 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:03.604624    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-d45ct container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 16:39:03.605041 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:03.604676    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct" podUID="06f10c2d-7091-46a7-96cf-ee563c4cadcc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 16:39:05.578977 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:05.578946    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-v5w5q"
May 21 16:39:06.605518 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:06.605486    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d45ct"
May 21 16:39:14.542645 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:39:14.542574    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-xmh77"
May 21 16:40:04.109721 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.109688    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"]
May 21 16:40:04.112978 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.112961    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"
May 21 16:40:04.115446 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.115423    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 16:40:04.116500 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.116475    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-q4428\""
May 21 16:40:04.116500 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.116491    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 16:40:04.116636 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.116495    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 16:40:04.122767 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.122743    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"]
May 21 16:40:04.249953 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.249916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knvt7\" (UniqueName: \"kubernetes.io/projected/5cefe289-a702-4ae2-83d8-dde37fb7b68a-kube-api-access-knvt7\") pod \"dns-operator-controller-manager-648d5c98bc-p9vdm\" (UID: \"5cefe289-a702-4ae2-83d8-dde37fb7b68a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"
May 21 16:40:04.351249 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.351219    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knvt7\" (UniqueName: \"kubernetes.io/projected/5cefe289-a702-4ae2-83d8-dde37fb7b68a-kube-api-access-knvt7\") pod \"dns-operator-controller-manager-648d5c98bc-p9vdm\" (UID: \"5cefe289-a702-4ae2-83d8-dde37fb7b68a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"
May 21 16:40:04.362114 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.362045    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knvt7\" (UniqueName: \"kubernetes.io/projected/5cefe289-a702-4ae2-83d8-dde37fb7b68a-kube-api-access-knvt7\") pod \"dns-operator-controller-manager-648d5c98bc-p9vdm\" (UID: \"5cefe289-a702-4ae2-83d8-dde37fb7b68a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"
May 21 16:40:04.423993 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.423960    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"
May 21 16:40:04.576120 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.576089    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"]
May 21 16:40:04.580188 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:40:04.580160    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cefe289_a702_4ae2_83d8_dde37fb7b68a.slice/crio-35422b84cb00bec8ef210bedbd52fc3c2d95a2ac67c42202dbbc943c760e1814 WatchSource:0}: Error finding container 35422b84cb00bec8ef210bedbd52fc3c2d95a2ac67c42202dbbc943c760e1814: Status 404 returned error can't find the container with id 35422b84cb00bec8ef210bedbd52fc3c2d95a2ac67c42202dbbc943c760e1814
May 21 16:40:04.797042 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:04.796998    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm" event={"ID":"5cefe289-a702-4ae2-83d8-dde37fb7b68a","Type":"ContainerStarted","Data":"35422b84cb00bec8ef210bedbd52fc3c2d95a2ac67c42202dbbc943c760e1814"}
May 21 16:40:06.805115 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:06.805080    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm" event={"ID":"5cefe289-a702-4ae2-83d8-dde37fb7b68a","Type":"ContainerStarted","Data":"58c325bf1c30bb3c5c51f421490660dd22353ca7acc1dd1171def3d705f74c0f"}
May 21 16:40:06.805534 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:06.805247    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"
May 21 16:40:06.826277 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:06.826215    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm" podStartSLOduration=1.050464245 podStartE2EDuration="2.826199183s" podCreationTimestamp="2026-05-21 16:40:04 +0000 UTC" firstStartedPulling="2026-05-21 16:40:04.582128393 +0000 UTC m=+494.745861006" lastFinishedPulling="2026-05-21 16:40:06.357863328 +0000 UTC m=+496.521595944" observedRunningTime="2026-05-21 16:40:06.824788168 +0000 UTC m=+496.988520803" watchObservedRunningTime="2026-05-21 16:40:06.826199183 +0000 UTC m=+496.989931817"
May 21 16:40:10.426596 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.426561    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-l87z9"]
May 21 16:40:10.429717 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.429697    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-l87z9"
May 21 16:40:10.432074 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.432050    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ztl5s\""
May 21 16:40:10.439535 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.439511    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-l87z9"]
May 21 16:40:10.605661 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.605616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvl6z\" (UniqueName: \"kubernetes.io/projected/f3060474-42b5-46c7-9ec1-95cc586d401d-kube-api-access-jvl6z\") pod \"authorino-operator-657f44b778-l87z9\" (UID: \"f3060474-42b5-46c7-9ec1-95cc586d401d\") " pod="kuadrant-system/authorino-operator-657f44b778-l87z9"
May 21 16:40:10.706179 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.706087    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvl6z\" (UniqueName: \"kubernetes.io/projected/f3060474-42b5-46c7-9ec1-95cc586d401d-kube-api-access-jvl6z\") pod \"authorino-operator-657f44b778-l87z9\" (UID: \"f3060474-42b5-46c7-9ec1-95cc586d401d\") " pod="kuadrant-system/authorino-operator-657f44b778-l87z9"
May 21 16:40:10.714770 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.714743    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvl6z\" (UniqueName: \"kubernetes.io/projected/f3060474-42b5-46c7-9ec1-95cc586d401d-kube-api-access-jvl6z\") pod \"authorino-operator-657f44b778-l87z9\" (UID: \"f3060474-42b5-46c7-9ec1-95cc586d401d\") " pod="kuadrant-system/authorino-operator-657f44b778-l87z9"
May 21 16:40:10.740647 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.740608    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-l87z9"
May 21 16:40:10.867608 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:10.867581    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-l87z9"]
May 21 16:40:10.869714 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:40:10.869685    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3060474_42b5_46c7_9ec1_95cc586d401d.slice/crio-d61abaf191d8c14ee8c445ad6c8c5af9fa7b77a690c83c6cedfa872c27913b0b WatchSource:0}: Error finding container d61abaf191d8c14ee8c445ad6c8c5af9fa7b77a690c83c6cedfa872c27913b0b: Status 404 returned error can't find the container with id d61abaf191d8c14ee8c445ad6c8c5af9fa7b77a690c83c6cedfa872c27913b0b
May 21 16:40:11.826362 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:11.826318    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-l87z9" event={"ID":"f3060474-42b5-46c7-9ec1-95cc586d401d","Type":"ContainerStarted","Data":"d61abaf191d8c14ee8c445ad6c8c5af9fa7b77a690c83c6cedfa872c27913b0b"}
May 21 16:40:12.830933 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:12.830893    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-l87z9" event={"ID":"f3060474-42b5-46c7-9ec1-95cc586d401d","Type":"ContainerStarted","Data":"f1edb0f50be801523dec324b7881aceb80c500c6205ecf44f0123a43f8622c18"}
May 21 16:40:12.831268 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:12.830954    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-l87z9"
May 21 16:40:12.849618 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:12.849572    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-l87z9" podStartSLOduration=1.01515069 podStartE2EDuration="2.849557656s" podCreationTimestamp="2026-05-21 16:40:10 +0000 UTC" firstStartedPulling="2026-05-21 16:40:10.871683057 +0000 UTC m=+501.035415670" lastFinishedPulling="2026-05-21 16:40:12.706090003 +0000 UTC m=+502.869822636" observedRunningTime="2026-05-21 16:40:12.847881944 +0000 UTC m=+503.011614579" watchObservedRunningTime="2026-05-21 16:40:12.849557656 +0000 UTC m=+503.013290291"
May 21 16:40:17.813265 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:17.813235    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-p9vdm"
May 21 16:40:20.345275 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.345238    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc4d54864-28b8t"]
May 21 16:40:20.348489 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.348469    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.351051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.351030    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 16:40:20.351181 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.351084    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 16:40:20.351950 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.351924    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-56r7t\""
May 21 16:40:20.352075 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.351964    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 16:40:20.352075 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.351980    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 16:40:20.352075 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.351964    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 16:40:20.352075 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.351967    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 16:40:20.352446 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.352430    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 16:40:20.357213 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.357184    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 16:40:20.370220 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.370194    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc4d54864-28b8t"]
May 21 16:40:20.486284 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.486241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-config\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.486284 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.486283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-service-ca\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.486539 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.486312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-serving-cert\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.486539 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.486377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-trusted-ca-bundle\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.486539 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.486412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-oauth-serving-cert\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.486539 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.486447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4285p\" (UniqueName: \"kubernetes.io/projected/7ce3af8d-3920-4e29-b994-35b9ee4c4720-kube-api-access-4285p\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.486539 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.486505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-oauth-config\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.587334 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.587291    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-trusted-ca-bundle\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.587569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.587352    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-oauth-serving-cert\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.587569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.587404    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4285p\" (UniqueName: \"kubernetes.io/projected/7ce3af8d-3920-4e29-b994-35b9ee4c4720-kube-api-access-4285p\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.587569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.587436    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-oauth-config\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.587569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.587473    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-config\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.587569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.587496    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-service-ca\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.587569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.587527    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-serving-cert\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.588241 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.588214    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-config\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.588241 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.588231    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-oauth-serving-cert\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.588416 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.588281    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-service-ca\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.588416 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.588289    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce3af8d-3920-4e29-b994-35b9ee4c4720-trusted-ca-bundle\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.589939 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.589919    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-oauth-config\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.590044 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.590027    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce3af8d-3920-4e29-b994-35b9ee4c4720-console-serving-cert\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.602716 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.602660    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4285p\" (UniqueName: \"kubernetes.io/projected/7ce3af8d-3920-4e29-b994-35b9ee4c4720-kube-api-access-4285p\") pod \"console-6bc4d54864-28b8t\" (UID: \"7ce3af8d-3920-4e29-b994-35b9ee4c4720\") " pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.659421 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.659390    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:20.790324 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.790290    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc4d54864-28b8t"]
May 21 16:40:20.793554 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:40:20.793524    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce3af8d_3920_4e29_b994_35b9ee4c4720.slice/crio-0cedab1384aa82cebd37c7c54da264b79ca4b6434dd460637f2b450bb5a577b8 WatchSource:0}: Error finding container 0cedab1384aa82cebd37c7c54da264b79ca4b6434dd460637f2b450bb5a577b8: Status 404 returned error can't find the container with id 0cedab1384aa82cebd37c7c54da264b79ca4b6434dd460637f2b450bb5a577b8
May 21 16:40:20.860207 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:20.860174    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc4d54864-28b8t" event={"ID":"7ce3af8d-3920-4e29-b994-35b9ee4c4720","Type":"ContainerStarted","Data":"0cedab1384aa82cebd37c7c54da264b79ca4b6434dd460637f2b450bb5a577b8"}
May 21 16:40:21.864074 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:21.864038    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc4d54864-28b8t" event={"ID":"7ce3af8d-3920-4e29-b994-35b9ee4c4720","Type":"ContainerStarted","Data":"8c1112a3372ad6340c613ac9cd52a252d2fb130189cbc8ad485b470e22d3f2b9"}
May 21 16:40:21.884308 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:21.884255    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6bc4d54864-28b8t" podStartSLOduration=1.8842401930000001 podStartE2EDuration="1.884240193s" podCreationTimestamp="2026-05-21 16:40:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:40:21.882951883 +0000 UTC m=+512.046684518" watchObservedRunningTime="2026-05-21 16:40:21.884240193 +0000 UTC m=+512.047972828"
May 21 16:40:23.836225 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:23.836193    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-l87z9"
May 21 16:40:30.660526 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:30.660496    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:30.661109 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:30.660536    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:30.665194 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:30.665171    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:30.897061 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:30.897032    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bc4d54864-28b8t"
May 21 16:40:49.761792 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.761697    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"]
May 21 16:40:49.764749 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.764717    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.767066 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.767044    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-l2cdb\""
May 21 16:40:49.777161 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.775972    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"]
May 21 16:40:49.821123 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821296 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963b791d-317e-4277-acd2-c68036758c6e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821296 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821176    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7tdc\" (UniqueName: \"kubernetes.io/projected/963b791d-317e-4277-acd2-c68036758c6e-kube-api-access-z7tdc\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821296 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821296 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821526 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821526 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963b791d-317e-4277-acd2-c68036758c6e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821526 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.821526 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.821511    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963b791d-317e-4277-acd2-c68036758c6e-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922132 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922054    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922352 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922151    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963b791d-317e-4277-acd2-c68036758c6e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922352 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922181    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7tdc\" (UniqueName: \"kubernetes.io/projected/963b791d-317e-4277-acd2-c68036758c6e-kube-api-access-z7tdc\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922352 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922208    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922352 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922257    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922352 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922304    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922679 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922522    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963b791d-317e-4277-acd2-c68036758c6e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922679 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922607    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922782 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922668    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922782 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922705    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922782 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922737    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922782 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922768    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963b791d-317e-4277-acd2-c68036758c6e-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.922966 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.922932    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963b791d-317e-4277-acd2-c68036758c6e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.923532 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.923505    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.931670 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.931471    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7tdc\" (UniqueName: \"kubernetes.io/projected/963b791d-317e-4277-acd2-c68036758c6e-kube-api-access-z7tdc\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.931670 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.931662    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963b791d-317e-4277-acd2-c68036758c6e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.932675 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.932647    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963b791d-317e-4277-acd2-c68036758c6e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:49.932886 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:49.932864    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963b791d-317e-4277-acd2-c68036758c6e-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cgq27\" (UID: \"963b791d-317e-4277-acd2-c68036758c6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:50.078794 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:50.078752    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:50.214900 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:50.214856    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"]
May 21 16:40:50.219019 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:40:50.218988    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963b791d_317e_4277_acd2_c68036758c6e.slice/crio-f51c37fc0a2c3f9602f3794e552a16318d8d70b666fee8f4364f4725293b35fa WatchSource:0}: Error finding container f51c37fc0a2c3f9602f3794e552a16318d8d70b666fee8f4364f4725293b35fa: Status 404 returned error can't find the container with id f51c37fc0a2c3f9602f3794e552a16318d8d70b666fee8f4364f4725293b35fa
May 21 16:40:50.957472 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:50.957420    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27" event={"ID":"963b791d-317e-4277-acd2-c68036758c6e","Type":"ContainerStarted","Data":"f51c37fc0a2c3f9602f3794e552a16318d8d70b666fee8f4364f4725293b35fa"}
May 21 16:40:53.018587 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:53.018535    2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
May 21 16:40:53.018967 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:53.018663    2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
May 21 16:40:53.018967 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:53.018706    2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
May 21 16:40:53.968778 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:53.968734    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27" event={"ID":"963b791d-317e-4277-acd2-c68036758c6e","Type":"ContainerStarted","Data":"5c71dc748035a9ef87dac8f42f147b56ccebf50f4af3d3232c6dac5249836fdc"}
May 21 16:40:53.989138 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:53.989080    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27" podStartSLOduration=2.191868278 podStartE2EDuration="4.989065067s" podCreationTimestamp="2026-05-21 16:40:49 +0000 UTC" firstStartedPulling="2026-05-21 16:40:50.220987069 +0000 UTC m=+540.384719682" lastFinishedPulling="2026-05-21 16:40:53.018183834 +0000 UTC m=+543.181916471" observedRunningTime="2026-05-21 16:40:53.987306187 +0000 UTC m=+544.151038824" watchObservedRunningTime="2026-05-21 16:40:53.989065067 +0000 UTC m=+544.152797701"
May 21 16:40:54.079110 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:54.079075    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:54.084338 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:54.084309    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:54.972146 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:54.972109    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:54.973027 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:54.973007    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cgq27"
May 21 16:40:55.424943 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.424910    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-9xwnk"]
May 21 16:40:55.428038 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.428020    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xwnk"
May 21 16:40:55.430508 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.430486    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-g9xmg\""
May 21 16:40:55.438296 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.438273    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xwnk"]
May 21 16:40:55.576949 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.576916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp7bw\" (UniqueName: \"kubernetes.io/projected/87244966-0416-48a7-8d3f-31cad6c38a87-kube-api-access-dp7bw\") pod \"authorino-7498df8756-9xwnk\" (UID: \"87244966-0416-48a7-8d3f-31cad6c38a87\") " pod="kuadrant-system/authorino-7498df8756-9xwnk"
May 21 16:40:55.677915 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.677840    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dp7bw\" (UniqueName: \"kubernetes.io/projected/87244966-0416-48a7-8d3f-31cad6c38a87-kube-api-access-dp7bw\") pod \"authorino-7498df8756-9xwnk\" (UID: \"87244966-0416-48a7-8d3f-31cad6c38a87\") " pod="kuadrant-system/authorino-7498df8756-9xwnk"
May 21 16:40:55.686302 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.686278    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp7bw\" (UniqueName: \"kubernetes.io/projected/87244966-0416-48a7-8d3f-31cad6c38a87-kube-api-access-dp7bw\") pod \"authorino-7498df8756-9xwnk\" (UID: \"87244966-0416-48a7-8d3f-31cad6c38a87\") " pod="kuadrant-system/authorino-7498df8756-9xwnk"
May 21 16:40:55.737879 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.737847    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xwnk"
May 21 16:40:55.860245 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.860196    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xwnk"]
May 21 16:40:55.862450 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:40:55.862421    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87244966_0416_48a7_8d3f_31cad6c38a87.slice/crio-01c36c42fc9bbecf7dec81cfe093e8d5ff981ad527b97102a27c88109d4cdf8e WatchSource:0}: Error finding container 01c36c42fc9bbecf7dec81cfe093e8d5ff981ad527b97102a27c88109d4cdf8e: Status 404 returned error can't find the container with id 01c36c42fc9bbecf7dec81cfe093e8d5ff981ad527b97102a27c88109d4cdf8e
May 21 16:40:55.976391 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:55.976305    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xwnk" event={"ID":"87244966-0416-48a7-8d3f-31cad6c38a87","Type":"ContainerStarted","Data":"01c36c42fc9bbecf7dec81cfe093e8d5ff981ad527b97102a27c88109d4cdf8e"}
May 21 16:40:59.990227 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:40:59.990192    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xwnk" event={"ID":"87244966-0416-48a7-8d3f-31cad6c38a87","Type":"ContainerStarted","Data":"2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989"}
May 21 16:41:00.005841 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:00.005796    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-9xwnk" podStartSLOduration=1.922002101 podStartE2EDuration="5.005782852s" podCreationTimestamp="2026-05-21 16:40:55 +0000 UTC" firstStartedPulling="2026-05-21 16:40:55.863960769 +0000 UTC m=+546.027693395" lastFinishedPulling="2026-05-21 16:40:58.947741532 +0000 UTC m=+549.111474146" observedRunningTime="2026-05-21 16:41:00.00434214 +0000 UTC m=+550.168074775" watchObservedRunningTime="2026-05-21 16:41:00.005782852 +0000 UTC m=+550.169515486"
May 21 16:41:30.013452 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:30.013402    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xwnk"]
May 21 16:41:30.013903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:30.013735    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-9xwnk" podUID="87244966-0416-48a7-8d3f-31cad6c38a87" containerName="authorino" containerID="cri-o://2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989" gracePeriod=30
May 21 16:41:30.262685 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:30.262657    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xwnk"
May 21 16:41:30.359739 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:30.359695    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp7bw\" (UniqueName: \"kubernetes.io/projected/87244966-0416-48a7-8d3f-31cad6c38a87-kube-api-access-dp7bw\") pod \"87244966-0416-48a7-8d3f-31cad6c38a87\" (UID: \"87244966-0416-48a7-8d3f-31cad6c38a87\") "
May 21 16:41:30.361955 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:30.361924    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87244966-0416-48a7-8d3f-31cad6c38a87-kube-api-access-dp7bw" (OuterVolumeSpecName: "kube-api-access-dp7bw") pod "87244966-0416-48a7-8d3f-31cad6c38a87" (UID: "87244966-0416-48a7-8d3f-31cad6c38a87"). InnerVolumeSpecName "kube-api-access-dp7bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:41:30.460837 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:30.460792    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp7bw\" (UniqueName: \"kubernetes.io/projected/87244966-0416-48a7-8d3f-31cad6c38a87-kube-api-access-dp7bw\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:41:31.100901 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.100865    2567 generic.go:358] "Generic (PLEG): container finished" podID="87244966-0416-48a7-8d3f-31cad6c38a87" containerID="2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989" exitCode=0
May 21 16:41:31.101317 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.100913    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xwnk"
May 21 16:41:31.101317 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.100958    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xwnk" event={"ID":"87244966-0416-48a7-8d3f-31cad6c38a87","Type":"ContainerDied","Data":"2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989"}
May 21 16:41:31.101317 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.100996    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xwnk" event={"ID":"87244966-0416-48a7-8d3f-31cad6c38a87","Type":"ContainerDied","Data":"01c36c42fc9bbecf7dec81cfe093e8d5ff981ad527b97102a27c88109d4cdf8e"}
May 21 16:41:31.101317 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.101013    2567 scope.go:117] "RemoveContainer" containerID="2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989"
May 21 16:41:31.109678 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.109659    2567 scope.go:117] "RemoveContainer" containerID="2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989"
May 21 16:41:31.109967 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:41:31.109939    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989\": container with ID starting with 2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989 not found: ID does not exist" containerID="2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989"
May 21 16:41:31.110051 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.109968    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989"} err="failed to get container status \"2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989\": rpc error: code = NotFound desc = could not find container \"2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989\": container with ID starting with 2bf7f76347ac64a1361b393195cef4c4365faf7cf3d0a92b6a778777153d7989 not found: ID does not exist"
May 21 16:41:31.122622 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.122590    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xwnk"]
May 21 16:41:31.124518 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:31.124494    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xwnk"]
May 21 16:41:32.320551 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:32.320509    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87244966-0416-48a7-8d3f-31cad6c38a87" path="/var/lib/kubelet/pods/87244966-0416-48a7-8d3f-31cad6c38a87/volumes"
May 21 16:41:33.090946 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.090910    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-845d87bcb8-m8wrj"]
May 21 16:41:33.091216 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.091204    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87244966-0416-48a7-8d3f-31cad6c38a87" containerName="authorino"
May 21 16:41:33.091256 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.091218    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="87244966-0416-48a7-8d3f-31cad6c38a87" containerName="authorino"
May 21 16:41:33.091289 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.091278    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="87244966-0416-48a7-8d3f-31cad6c38a87" containerName="authorino"
May 21 16:41:33.095584 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.095566    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:33.098191 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.098166    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 16:41:33.098341 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.098166    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7rwqh\""
May 21 16:41:33.102810 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.102780    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-845d87bcb8-m8wrj"]
May 21 16:41:33.183876 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.183836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdml6\" (UniqueName: \"kubernetes.io/projected/0fa97752-cea8-4e51-957d-14ef532f3aca-kube-api-access-bdml6\") pod \"maas-controller-845d87bcb8-m8wrj\" (UID: \"0fa97752-cea8-4e51-957d-14ef532f3aca\") " pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:33.242578 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.242538    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fd6675fb9-jxxjz"]
May 21 16:41:33.245759 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.245735    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:41:33.254533 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.254507    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fd6675fb9-jxxjz"]
May 21 16:41:33.284301 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.284264    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdml6\" (UniqueName: \"kubernetes.io/projected/0fa97752-cea8-4e51-957d-14ef532f3aca-kube-api-access-bdml6\") pod \"maas-controller-845d87bcb8-m8wrj\" (UID: \"0fa97752-cea8-4e51-957d-14ef532f3aca\") " pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:33.284517 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.284306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkpr4\" (UniqueName: \"kubernetes.io/projected/20d1f637-82fd-4290-8f80-c0b5e0f42f74-kube-api-access-rkpr4\") pod \"maas-controller-fd6675fb9-jxxjz\" (UID: \"20d1f637-82fd-4290-8f80-c0b5e0f42f74\") " pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:41:33.292826 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.292786    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdml6\" (UniqueName: \"kubernetes.io/projected/0fa97752-cea8-4e51-957d-14ef532f3aca-kube-api-access-bdml6\") pod \"maas-controller-845d87bcb8-m8wrj\" (UID: \"0fa97752-cea8-4e51-957d-14ef532f3aca\") " pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:33.385247 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.385150    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkpr4\" (UniqueName: \"kubernetes.io/projected/20d1f637-82fd-4290-8f80-c0b5e0f42f74-kube-api-access-rkpr4\") pod \"maas-controller-fd6675fb9-jxxjz\" (UID: \"20d1f637-82fd-4290-8f80-c0b5e0f42f74\") " pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:41:33.393723 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.393698    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkpr4\" (UniqueName: \"kubernetes.io/projected/20d1f637-82fd-4290-8f80-c0b5e0f42f74-kube-api-access-rkpr4\") pod \"maas-controller-fd6675fb9-jxxjz\" (UID: \"20d1f637-82fd-4290-8f80-c0b5e0f42f74\") " pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:41:33.407580 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.407546    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:33.535429 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.535346    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-845d87bcb8-m8wrj"]
May 21 16:41:33.537923 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:41:33.537898    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa97752_cea8_4e51_957d_14ef532f3aca.slice/crio-c25baafa56b8b2b8459b5b7ce9dfd4ea8040d96a5f3cc53ab4d630db3cbc0aab WatchSource:0}: Error finding container c25baafa56b8b2b8459b5b7ce9dfd4ea8040d96a5f3cc53ab4d630db3cbc0aab: Status 404 returned error can't find the container with id c25baafa56b8b2b8459b5b7ce9dfd4ea8040d96a5f3cc53ab4d630db3cbc0aab
May 21 16:41:33.556909 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.556882    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:41:33.683183 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:33.683155    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fd6675fb9-jxxjz"]
May 21 16:41:33.685324 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:41:33.685296    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d1f637_82fd_4290_8f80_c0b5e0f42f74.slice/crio-8c27a8ecf68f7d8b2be14a08c840defee91435365d69b88af5ad4cd0bb9bfd74 WatchSource:0}: Error finding container 8c27a8ecf68f7d8b2be14a08c840defee91435365d69b88af5ad4cd0bb9bfd74: Status 404 returned error can't find the container with id 8c27a8ecf68f7d8b2be14a08c840defee91435365d69b88af5ad4cd0bb9bfd74
May 21 16:41:34.115832 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:34.115788    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd6675fb9-jxxjz" event={"ID":"20d1f637-82fd-4290-8f80-c0b5e0f42f74","Type":"ContainerStarted","Data":"8c27a8ecf68f7d8b2be14a08c840defee91435365d69b88af5ad4cd0bb9bfd74"}
May 21 16:41:34.117090 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:34.117057    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-845d87bcb8-m8wrj" event={"ID":"0fa97752-cea8-4e51-957d-14ef532f3aca","Type":"ContainerStarted","Data":"c25baafa56b8b2b8459b5b7ce9dfd4ea8040d96a5f3cc53ab4d630db3cbc0aab"}
May 21 16:41:37.129354 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:37.129315    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd6675fb9-jxxjz" event={"ID":"20d1f637-82fd-4290-8f80-c0b5e0f42f74","Type":"ContainerStarted","Data":"00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147"}
May 21 16:41:37.129833 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:37.129405    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:41:37.130706 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:37.130683    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-845d87bcb8-m8wrj" event={"ID":"0fa97752-cea8-4e51-957d-14ef532f3aca","Type":"ContainerStarted","Data":"454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5"}
May 21 16:41:37.130887 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:37.130875    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:37.146071 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:37.146014    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-fd6675fb9-jxxjz" podStartSLOduration=1.6361375379999998 podStartE2EDuration="4.145998987s" podCreationTimestamp="2026-05-21 16:41:33 +0000 UTC" firstStartedPulling="2026-05-21 16:41:33.68659097 +0000 UTC m=+583.850323584" lastFinishedPulling="2026-05-21 16:41:36.196452417 +0000 UTC m=+586.360185033" observedRunningTime="2026-05-21 16:41:37.144245023 +0000 UTC m=+587.307977662" watchObservedRunningTime="2026-05-21 16:41:37.145998987 +0000 UTC m=+587.309731621"
May 21 16:41:37.159209 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:37.159156    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-845d87bcb8-m8wrj" podStartSLOduration=1.49266311 podStartE2EDuration="4.159138828s" podCreationTimestamp="2026-05-21 16:41:33 +0000 UTC" firstStartedPulling="2026-05-21 16:41:33.539532393 +0000 UTC m=+583.703265007" lastFinishedPulling="2026-05-21 16:41:36.206008109 +0000 UTC m=+586.369740725" observedRunningTime="2026-05-21 16:41:37.158230761 +0000 UTC m=+587.321963400" watchObservedRunningTime="2026-05-21 16:41:37.159138828 +0000 UTC m=+587.322871463"
May 21 16:41:48.140610 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.140572    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:48.141032 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.140631    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:41:48.192988 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.192927    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-845d87bcb8-m8wrj"]
May 21 16:41:48.193381 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.193327    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-845d87bcb8-m8wrj" podUID="0fa97752-cea8-4e51-957d-14ef532f3aca" containerName="manager" containerID="cri-o://454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5" gracePeriod=30
May 21 16:41:48.456845 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.456811    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:48.525420 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.525362    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdml6\" (UniqueName: \"kubernetes.io/projected/0fa97752-cea8-4e51-957d-14ef532f3aca-kube-api-access-bdml6\") pod \"0fa97752-cea8-4e51-957d-14ef532f3aca\" (UID: \"0fa97752-cea8-4e51-957d-14ef532f3aca\") "
May 21 16:41:48.527987 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.527943    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa97752-cea8-4e51-957d-14ef532f3aca-kube-api-access-bdml6" (OuterVolumeSpecName: "kube-api-access-bdml6") pod "0fa97752-cea8-4e51-957d-14ef532f3aca" (UID: "0fa97752-cea8-4e51-957d-14ef532f3aca"). InnerVolumeSpecName "kube-api-access-bdml6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:41:48.626446 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:48.626397    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdml6\" (UniqueName: \"kubernetes.io/projected/0fa97752-cea8-4e51-957d-14ef532f3aca-kube-api-access-bdml6\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:41:49.175209 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.175156    2567 generic.go:358] "Generic (PLEG): container finished" podID="0fa97752-cea8-4e51-957d-14ef532f3aca" containerID="454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5" exitCode=0
May 21 16:41:49.175779 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.175228    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-845d87bcb8-m8wrj"
May 21 16:41:49.175779 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.175237    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-845d87bcb8-m8wrj" event={"ID":"0fa97752-cea8-4e51-957d-14ef532f3aca","Type":"ContainerDied","Data":"454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5"}
May 21 16:41:49.175779 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.175277    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-845d87bcb8-m8wrj" event={"ID":"0fa97752-cea8-4e51-957d-14ef532f3aca","Type":"ContainerDied","Data":"c25baafa56b8b2b8459b5b7ce9dfd4ea8040d96a5f3cc53ab4d630db3cbc0aab"}
May 21 16:41:49.175779 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.175293    2567 scope.go:117] "RemoveContainer" containerID="454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5"
May 21 16:41:49.184665 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.184641    2567 scope.go:117] "RemoveContainer" containerID="454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5"
May 21 16:41:49.185024 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:41:49.185004    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5\": container with ID starting with 454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5 not found: ID does not exist" containerID="454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5"
May 21 16:41:49.185076 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.185037    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5"} err="failed to get container status \"454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5\": rpc error: code = NotFound desc = could not find container \"454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5\": container with ID starting with 454cc5b6c2df56182e1866015463fc2298b5f6e54580bf34544a8d702838e0c5 not found: ID does not exist"
May 21 16:41:49.196693 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.196646    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-845d87bcb8-m8wrj"]
May 21 16:41:49.202394 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:49.202351    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-845d87bcb8-m8wrj"]
May 21 16:41:50.322607 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:41:50.322561    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fa97752-cea8-4e51-957d-14ef532f3aca" path="/var/lib/kubelet/pods/0fa97752-cea8-4e51-957d-14ef532f3aca/volumes"
May 21 16:42:04.533904 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.533865    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5b7bc457ff-frv4z"]
May 21 16:42:04.536324 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.534161    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa97752-cea8-4e51-957d-14ef532f3aca" containerName="manager"
May 21 16:42:04.536324 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.534173    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa97752-cea8-4e51-957d-14ef532f3aca" containerName="manager"
May 21 16:42:04.536324 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.534241    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fa97752-cea8-4e51-957d-14ef532f3aca" containerName="manager"
May 21 16:42:04.537271 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.537253    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.539686 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.539666    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bzpx5\""
May 21 16:42:04.539808 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.539666    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 16:42:04.546873 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.546842    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b7bc457ff-frv4z"]
May 21 16:42:04.673119 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.673086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df8zz\" (UniqueName: \"kubernetes.io/projected/c531c151-15f4-443c-9d4a-147d5873d01b-kube-api-access-df8zz\") pod \"maas-api-5b7bc457ff-frv4z\" (UID: \"c531c151-15f4-443c-9d4a-147d5873d01b\") " pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.673295 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.673204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c531c151-15f4-443c-9d4a-147d5873d01b-maas-api-tls\") pod \"maas-api-5b7bc457ff-frv4z\" (UID: \"c531c151-15f4-443c-9d4a-147d5873d01b\") " pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.774350 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.774315    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c531c151-15f4-443c-9d4a-147d5873d01b-maas-api-tls\") pod \"maas-api-5b7bc457ff-frv4z\" (UID: \"c531c151-15f4-443c-9d4a-147d5873d01b\") " pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.774570 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.774377    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df8zz\" (UniqueName: \"kubernetes.io/projected/c531c151-15f4-443c-9d4a-147d5873d01b-kube-api-access-df8zz\") pod \"maas-api-5b7bc457ff-frv4z\" (UID: \"c531c151-15f4-443c-9d4a-147d5873d01b\") " pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.776990 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.776963    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c531c151-15f4-443c-9d4a-147d5873d01b-maas-api-tls\") pod \"maas-api-5b7bc457ff-frv4z\" (UID: \"c531c151-15f4-443c-9d4a-147d5873d01b\") " pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.785324 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.785269    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df8zz\" (UniqueName: \"kubernetes.io/projected/c531c151-15f4-443c-9d4a-147d5873d01b-kube-api-access-df8zz\") pod \"maas-api-5b7bc457ff-frv4z\" (UID: \"c531c151-15f4-443c-9d4a-147d5873d01b\") " pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.847892 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.847857    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:04.885823 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.885791    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"]
May 21 16:42:04.890168 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.890150    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"
May 21 16:42:04.892808 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.892785    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 21 16:42:04.892932 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.892915    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xw6cl\""
May 21 16:42:04.902910 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.902878    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"]
May 21 16:42:04.983324 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:04.983300    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b7bc457ff-frv4z"]
May 21 16:42:04.985891 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:42:04.985866    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc531c151_15f4_443c_9d4a_147d5873d01b.slice/crio-e4a4daabcc5be319edbe680b384ca04fd02c87c532b1bbb954c198cda6c0d22f WatchSource:0}: Error finding container e4a4daabcc5be319edbe680b384ca04fd02c87c532b1bbb954c198cda6c0d22f: Status 404 returned error can't find the container with id e4a4daabcc5be319edbe680b384ca04fd02c87c532b1bbb954c198cda6c0d22f
May 21 16:42:05.077660 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:05.077572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gzh7\" (UniqueName: \"kubernetes.io/projected/d8be316f-2a8b-431f-8540-24554cdf6eb1-kube-api-access-8gzh7\") pod \"payload-processing-58b6c8fdc7-xhq4m\" (UID: \"d8be316f-2a8b-431f-8540-24554cdf6eb1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"
May 21 16:42:05.178832 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:05.178796    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gzh7\" (UniqueName: \"kubernetes.io/projected/d8be316f-2a8b-431f-8540-24554cdf6eb1-kube-api-access-8gzh7\") pod \"payload-processing-58b6c8fdc7-xhq4m\" (UID: \"d8be316f-2a8b-431f-8540-24554cdf6eb1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"
May 21 16:42:05.193230 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:05.193209    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gzh7\" (UniqueName: \"kubernetes.io/projected/d8be316f-2a8b-431f-8540-24554cdf6eb1-kube-api-access-8gzh7\") pod \"payload-processing-58b6c8fdc7-xhq4m\" (UID: \"d8be316f-2a8b-431f-8540-24554cdf6eb1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"
May 21 16:42:05.207183 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:05.207153    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"
May 21 16:42:05.237254 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:05.237219    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b7bc457ff-frv4z" event={"ID":"c531c151-15f4-443c-9d4a-147d5873d01b","Type":"ContainerStarted","Data":"e4a4daabcc5be319edbe680b384ca04fd02c87c532b1bbb954c198cda6c0d22f"}
May 21 16:42:05.337616 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:05.337576    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"]
May 21 16:42:05.339825 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:42:05.339796    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8be316f_2a8b_431f_8540_24554cdf6eb1.slice/crio-f74676a9aa75cc1adc93c4e733419546fafc0b412a33a133eb26b7de6a9931dd WatchSource:0}: Error finding container f74676a9aa75cc1adc93c4e733419546fafc0b412a33a133eb26b7de6a9931dd: Status 404 returned error can't find the container with id f74676a9aa75cc1adc93c4e733419546fafc0b412a33a133eb26b7de6a9931dd
May 21 16:42:06.244369 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:06.244324    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m" event={"ID":"d8be316f-2a8b-431f-8540-24554cdf6eb1","Type":"ContainerStarted","Data":"f74676a9aa75cc1adc93c4e733419546fafc0b412a33a133eb26b7de6a9931dd"}
May 21 16:42:08.252726 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:08.252672    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m" event={"ID":"d8be316f-2a8b-431f-8540-24554cdf6eb1","Type":"ContainerStarted","Data":"48adf067e7e59aea5b31cd7e9a2443becb0272fb85e8017f19ba7adfc555fd4a"}
May 21 16:42:08.253193 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:08.252843    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"
May 21 16:42:08.254218 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:08.254188    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b7bc457ff-frv4z" event={"ID":"c531c151-15f4-443c-9d4a-147d5873d01b","Type":"ContainerStarted","Data":"1f09c75e3eda395278563720cec80d900dd38d331c946c3771887b54eb9bad13"}
May 21 16:42:08.254349 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:08.254326    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:08.267833 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:08.267783    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m" podStartSLOduration=2.353152949 podStartE2EDuration="4.267761543s" podCreationTimestamp="2026-05-21 16:42:04 +0000 UTC" firstStartedPulling="2026-05-21 16:42:05.341561017 +0000 UTC m=+615.505293629" lastFinishedPulling="2026-05-21 16:42:07.256169606 +0000 UTC m=+617.419902223" observedRunningTime="2026-05-21 16:42:08.267114204 +0000 UTC m=+618.430846839" watchObservedRunningTime="2026-05-21 16:42:08.267761543 +0000 UTC m=+618.431494175"
May 21 16:42:08.282106 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:08.282061    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5b7bc457ff-frv4z" podStartSLOduration=2.015267691 podStartE2EDuration="4.282023074s" podCreationTimestamp="2026-05-21 16:42:04 +0000 UTC" firstStartedPulling="2026-05-21 16:42:04.987542695 +0000 UTC m=+615.151275309" lastFinishedPulling="2026-05-21 16:42:07.254298076 +0000 UTC m=+617.418030692" observedRunningTime="2026-05-21 16:42:08.281232454 +0000 UTC m=+618.444965090" watchObservedRunningTime="2026-05-21 16:42:08.282023074 +0000 UTC m=+618.445755708"
May 21 16:42:14.263324 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:14.263242    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5b7bc457ff-frv4z"
May 21 16:42:19.259890 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:19.259852    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-xhq4m"
May 21 16:42:24.350190 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.350146    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"]
May 21 16:42:24.354626 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.354586    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.358011 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.357979    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 21 16:42:24.358011 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.358004    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-46n4s\""
May 21 16:42:24.358227 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.358005    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 16:42:24.358227 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.358006    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 16:42:24.363691 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.363653    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"]
May 21 16:42:24.444516 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.444474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b704abf6-598a-4a7d-8e5d-252424cef0a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.444516 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.444520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.444793 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.444545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.444793 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.444638    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.444793 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.444695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrxx\" (UniqueName: \"kubernetes.io/projected/b704abf6-598a-4a7d-8e5d-252424cef0a1-kube-api-access-8zrxx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.444793 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.444723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545265 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545227    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrxx\" (UniqueName: \"kubernetes.io/projected/b704abf6-598a-4a7d-8e5d-252424cef0a1-kube-api-access-8zrxx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545509 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545273    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545509 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545315    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b704abf6-598a-4a7d-8e5d-252424cef0a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545509 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545339    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545509 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545368    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545509 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545401    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545800 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545776    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.545860 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.545832    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.546085 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.546051    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.547784 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.547764    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b704abf6-598a-4a7d-8e5d-252424cef0a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.548053 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.548034    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b704abf6-598a-4a7d-8e5d-252424cef0a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.554087 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.554039    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrxx\" (UniqueName: \"kubernetes.io/projected/b704abf6-598a-4a7d-8e5d-252424cef0a1-kube-api-access-8zrxx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-zgkqv\" (UID: \"b704abf6-598a-4a7d-8e5d-252424cef0a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.666772 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.666639    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:24.813906 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:24.813846    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"]
May 21 16:42:24.818287 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:42:24.818247    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb704abf6_598a_4a7d_8e5d_252424cef0a1.slice/crio-d35c28a862f9bb0429fce5a726e4652d2c3dd7a14799326efc74d3848cb5dcac WatchSource:0}: Error finding container d35c28a862f9bb0429fce5a726e4652d2c3dd7a14799326efc74d3848cb5dcac: Status 404 returned error can't find the container with id d35c28a862f9bb0429fce5a726e4652d2c3dd7a14799326efc74d3848cb5dcac
May 21 16:42:25.317638 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:25.317600    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv" event={"ID":"b704abf6-598a-4a7d-8e5d-252424cef0a1","Type":"ContainerStarted","Data":"d35c28a862f9bb0429fce5a726e4652d2c3dd7a14799326efc74d3848cb5dcac"}
May 21 16:42:31.350944 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:31.350902    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv" event={"ID":"b704abf6-598a-4a7d-8e5d-252424cef0a1","Type":"ContainerStarted","Data":"7931a822395be500a3a0c68b3301048191b9ab2924252d712eb1fbd3b091a58d"}
May 21 16:42:33.743100 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.743054    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"]
May 21 16:42:33.746793 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.746765    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.749259 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.749230    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 16:42:33.756428 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.756391    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"]
May 21 16:42:33.840260 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.840203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlcj7\" (UniqueName: \"kubernetes.io/projected/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-kube-api-access-zlcj7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.840514 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.840332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.840514 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.840373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.840514 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.840411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.840514 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.840435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.840514 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.840495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941057 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941013    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlcj7\" (UniqueName: \"kubernetes.io/projected/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-kube-api-access-zlcj7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941269 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941116    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941269 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941148    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941269 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941188    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941561 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941525    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941703 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941580    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941703 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941611    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941703 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941624    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.941861 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.941717    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.943970 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.943924    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.944295 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.944273    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:33.949592 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:33.949554    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlcj7\" (UniqueName: \"kubernetes.io/projected/3e5ca6ee-e937-429a-bd66-2f5c6c7af748-kube-api-access-zlcj7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr\" (UID: \"3e5ca6ee-e937-429a-bd66-2f5c6c7af748\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:34.059922 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:34.059877    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:34.219831 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:34.219798    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"]
May 21 16:42:34.222031 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:42:34.221992    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5ca6ee_e937_429a_bd66_2f5c6c7af748.slice/crio-809093ca264a29d46929768cdca6ff112e99403c87aa96207fc3cb6618828cb6 WatchSource:0}: Error finding container 809093ca264a29d46929768cdca6ff112e99403c87aa96207fc3cb6618828cb6: Status 404 returned error can't find the container with id 809093ca264a29d46929768cdca6ff112e99403c87aa96207fc3cb6618828cb6
May 21 16:42:34.365859 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:34.365704    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr" event={"ID":"3e5ca6ee-e937-429a-bd66-2f5c6c7af748","Type":"ContainerStarted","Data":"82d42441ceca17eaad0af6fbcf8b3a686fab25e4cb3837df67ed3dfbd06c114b"}
May 21 16:42:34.365859 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:34.365782    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr" event={"ID":"3e5ca6ee-e937-429a-bd66-2f5c6c7af748","Type":"ContainerStarted","Data":"809093ca264a29d46929768cdca6ff112e99403c87aa96207fc3cb6618828cb6"}
May 21 16:42:37.378555 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:37.378514    2567 generic.go:358] "Generic (PLEG): container finished" podID="b704abf6-598a-4a7d-8e5d-252424cef0a1" containerID="7931a822395be500a3a0c68b3301048191b9ab2924252d712eb1fbd3b091a58d" exitCode=0
May 21 16:42:37.378966 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:37.378560    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv" event={"ID":"b704abf6-598a-4a7d-8e5d-252424cef0a1","Type":"ContainerDied","Data":"7931a822395be500a3a0c68b3301048191b9ab2924252d712eb1fbd3b091a58d"}
May 21 16:42:39.391729 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:39.391682    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv" event={"ID":"b704abf6-598a-4a7d-8e5d-252424cef0a1","Type":"ContainerStarted","Data":"4dd8907f483dd17c513ca33589f7638ce4547850dbf6fd4852d0595db378b840"}
May 21 16:42:39.392176 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:39.391940    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:39.412741 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:39.412661    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv" podStartSLOduration=1.495733389 podStartE2EDuration="15.412636268s" podCreationTimestamp="2026-05-21 16:42:24 +0000 UTC" firstStartedPulling="2026-05-21 16:42:24.820782582 +0000 UTC m=+634.984515195" lastFinishedPulling="2026-05-21 16:42:38.737685462 +0000 UTC m=+648.901418074" observedRunningTime="2026-05-21 16:42:39.40924983 +0000 UTC m=+649.572982465" watchObservedRunningTime="2026-05-21 16:42:39.412636268 +0000 UTC m=+649.576368905"
May 21 16:42:44.415767 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:44.415633    2567 generic.go:358] "Generic (PLEG): container finished" podID="3e5ca6ee-e937-429a-bd66-2f5c6c7af748" containerID="82d42441ceca17eaad0af6fbcf8b3a686fab25e4cb3837df67ed3dfbd06c114b" exitCode=0
May 21 16:42:44.415767 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:44.415709    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr" event={"ID":"3e5ca6ee-e937-429a-bd66-2f5c6c7af748","Type":"ContainerDied","Data":"82d42441ceca17eaad0af6fbcf8b3a686fab25e4cb3837df67ed3dfbd06c114b"}
May 21 16:42:45.421128 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:45.421087    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr" event={"ID":"3e5ca6ee-e937-429a-bd66-2f5c6c7af748","Type":"ContainerStarted","Data":"b2d48c0c03610a78b7c71a87d59ba39da47a81eac395592e79e965d75db3510c"}
May 21 16:42:45.421622 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:45.421309    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:42:45.445245 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:45.445194    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr" podStartSLOduration=12.221986382 podStartE2EDuration="12.445178137s" podCreationTimestamp="2026-05-21 16:42:33 +0000 UTC" firstStartedPulling="2026-05-21 16:42:44.416659922 +0000 UTC m=+654.580392535" lastFinishedPulling="2026-05-21 16:42:44.639851668 +0000 UTC m=+654.803584290" observedRunningTime="2026-05-21 16:42:45.444962759 +0000 UTC m=+655.608695393" watchObservedRunningTime="2026-05-21 16:42:45.445178137 +0000 UTC m=+655.608910772"
May 21 16:42:50.411595 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:50.411562    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-zgkqv"
May 21 16:42:56.437863 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:42:56.437824    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr"
May 21 16:44:07.802030 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:07.801991    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-599c75dc45-lvm5w"]
May 21 16:44:07.804260 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:07.804241    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:07.807854 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:07.807830    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-g9xmg\""
May 21 16:44:07.807994 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:07.807866    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 21 16:44:07.812943 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:07.812916    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599c75dc45-lvm5w"]
May 21 16:44:07.941976 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:07.941919    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbtw4\" (UniqueName: \"kubernetes.io/projected/356fd82e-ac95-4e2e-a456-b3c590c342db-kube-api-access-bbtw4\") pod \"authorino-599c75dc45-lvm5w\" (UID: \"356fd82e-ac95-4e2e-a456-b3c590c342db\") " pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:07.942231 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:07.942033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/356fd82e-ac95-4e2e-a456-b3c590c342db-tls-cert\") pod \"authorino-599c75dc45-lvm5w\" (UID: \"356fd82e-ac95-4e2e-a456-b3c590c342db\") " pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:08.043436 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.043364    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbtw4\" (UniqueName: \"kubernetes.io/projected/356fd82e-ac95-4e2e-a456-b3c590c342db-kube-api-access-bbtw4\") pod \"authorino-599c75dc45-lvm5w\" (UID: \"356fd82e-ac95-4e2e-a456-b3c590c342db\") " pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:08.043677 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.043486    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/356fd82e-ac95-4e2e-a456-b3c590c342db-tls-cert\") pod \"authorino-599c75dc45-lvm5w\" (UID: \"356fd82e-ac95-4e2e-a456-b3c590c342db\") " pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:08.046121 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.046089    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/356fd82e-ac95-4e2e-a456-b3c590c342db-tls-cert\") pod \"authorino-599c75dc45-lvm5w\" (UID: \"356fd82e-ac95-4e2e-a456-b3c590c342db\") " pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:08.054531 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.054423    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbtw4\" (UniqueName: \"kubernetes.io/projected/356fd82e-ac95-4e2e-a456-b3c590c342db-kube-api-access-bbtw4\") pod \"authorino-599c75dc45-lvm5w\" (UID: \"356fd82e-ac95-4e2e-a456-b3c590c342db\") " pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:08.115602 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.115561    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599c75dc45-lvm5w"
May 21 16:44:08.265618 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.265584    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599c75dc45-lvm5w"]
May 21 16:44:08.268764 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:44:08.268726    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod356fd82e_ac95_4e2e_a456_b3c590c342db.slice/crio-ff2c020b7ace1a7c137a5848158b9108abc84d04e9de3ce5d95bbe635bde9323 WatchSource:0}: Error finding container ff2c020b7ace1a7c137a5848158b9108abc84d04e9de3ce5d95bbe635bde9323: Status 404 returned error can't find the container with id ff2c020b7ace1a7c137a5848158b9108abc84d04e9de3ce5d95bbe635bde9323
May 21 16:44:08.270365 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.270338    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:44:08.716921 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:08.716883    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599c75dc45-lvm5w" event={"ID":"356fd82e-ac95-4e2e-a456-b3c590c342db","Type":"ContainerStarted","Data":"ff2c020b7ace1a7c137a5848158b9108abc84d04e9de3ce5d95bbe635bde9323"}
May 21 16:44:09.721719 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:09.721678    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599c75dc45-lvm5w" event={"ID":"356fd82e-ac95-4e2e-a456-b3c590c342db","Type":"ContainerStarted","Data":"492d1ad8c0e894cb9cce681d2195a30fca79a0ccb1bf181c32489e148b2b3312"}
May 21 16:44:09.738105 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:44:09.738044    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-599c75dc45-lvm5w" podStartSLOduration=2.193738043 podStartE2EDuration="2.73802498s" podCreationTimestamp="2026-05-21 16:44:07 +0000 UTC" firstStartedPulling="2026-05-21 16:44:08.270539864 +0000 UTC m=+738.434272491" lastFinishedPulling="2026-05-21 16:44:08.814826796 +0000 UTC m=+738.978559428" observedRunningTime="2026-05-21 16:44:09.735717565 +0000 UTC m=+739.899450200" watchObservedRunningTime="2026-05-21 16:44:09.73802498 +0000 UTC m=+739.901757615"
May 21 16:45:37.144834 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:37.144800    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fd6675fb9-jxxjz"]
May 21 16:45:37.145358 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:37.145033    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-fd6675fb9-jxxjz" podUID="20d1f637-82fd-4290-8f80-c0b5e0f42f74" containerName="manager" containerID="cri-o://00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147" gracePeriod=30
May 21 16:45:37.390709 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:37.390686    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:45:37.518657 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:37.518559    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkpr4\" (UniqueName: \"kubernetes.io/projected/20d1f637-82fd-4290-8f80-c0b5e0f42f74-kube-api-access-rkpr4\") pod \"20d1f637-82fd-4290-8f80-c0b5e0f42f74\" (UID: \"20d1f637-82fd-4290-8f80-c0b5e0f42f74\") "
May 21 16:45:37.520654 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:37.520626    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d1f637-82fd-4290-8f80-c0b5e0f42f74-kube-api-access-rkpr4" (OuterVolumeSpecName: "kube-api-access-rkpr4") pod "20d1f637-82fd-4290-8f80-c0b5e0f42f74" (UID: "20d1f637-82fd-4290-8f80-c0b5e0f42f74"). InnerVolumeSpecName "kube-api-access-rkpr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:45:37.619768 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:37.619730    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkpr4\" (UniqueName: \"kubernetes.io/projected/20d1f637-82fd-4290-8f80-c0b5e0f42f74-kube-api-access-rkpr4\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
May 21 16:45:38.031540 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.031503    2567 generic.go:358] "Generic (PLEG): container finished" podID="20d1f637-82fd-4290-8f80-c0b5e0f42f74" containerID="00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147" exitCode=0
May 21 16:45:38.031716 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.031565    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd6675fb9-jxxjz"
May 21 16:45:38.031716 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.031584    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd6675fb9-jxxjz" event={"ID":"20d1f637-82fd-4290-8f80-c0b5e0f42f74","Type":"ContainerDied","Data":"00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147"}
May 21 16:45:38.031716 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.031620    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd6675fb9-jxxjz" event={"ID":"20d1f637-82fd-4290-8f80-c0b5e0f42f74","Type":"ContainerDied","Data":"8c27a8ecf68f7d8b2be14a08c840defee91435365d69b88af5ad4cd0bb9bfd74"}
May 21 16:45:38.031716 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.031635    2567 scope.go:117] "RemoveContainer" containerID="00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147"
May 21 16:45:38.041151 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.041132    2567 scope.go:117] "RemoveContainer" containerID="00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147"
May 21 16:45:38.041498 ip-10-0-141-23 kubenswrapper[2567]: E0521 16:45:38.041475    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147\": container with ID starting with 00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147 not found: ID does not exist" containerID="00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147"
May 21 16:45:38.041575 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.041506    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147"} err="failed to get container status \"00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147\": rpc error: code = NotFound desc = could not find container \"00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147\": container with ID starting with 00d669d3ba4871eb055da318e9036a0b97c5025c96678bca2a33b55a3b272147 not found: ID does not exist"
May 21 16:45:38.056225 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.056196    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fd6675fb9-jxxjz"]
May 21 16:45:38.059739 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.059717    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fd6675fb9-jxxjz"]
May 21 16:45:38.320569 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.320491    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d1f637-82fd-4290-8f80-c0b5e0f42f74" path="/var/lib/kubelet/pods/20d1f637-82fd-4290-8f80-c0b5e0f42f74/volumes"
May 21 16:45:38.830699 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.830669    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fd6675fb9-fn46r"]
May 21 16:45:38.830988 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.830977    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d1f637-82fd-4290-8f80-c0b5e0f42f74" containerName="manager"
May 21 16:45:38.831035 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.830990    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d1f637-82fd-4290-8f80-c0b5e0f42f74" containerName="manager"
May 21 16:45:38.831069 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.831052    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="20d1f637-82fd-4290-8f80-c0b5e0f42f74" containerName="manager"
May 21 16:45:38.835222 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.835205    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd6675fb9-fn46r"
May 21 16:45:38.837814 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.837799    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7rwqh\""
May 21 16:45:38.837903 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.837799    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 16:45:38.843917 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.843896    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fd6675fb9-fn46r"]
May 21 16:45:38.931955 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:38.931928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxm9\" (UniqueName: \"kubernetes.io/projected/44038ae5-b8f1-42b8-ae98-b86ed3e49e67-kube-api-access-lxxm9\") pod \"maas-controller-fd6675fb9-fn46r\" (UID: \"44038ae5-b8f1-42b8-ae98-b86ed3e49e67\") " pod="opendatahub/maas-controller-fd6675fb9-fn46r"
May 21 16:45:39.032811 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:39.032782    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxm9\" (UniqueName: \"kubernetes.io/projected/44038ae5-b8f1-42b8-ae98-b86ed3e49e67-kube-api-access-lxxm9\") pod \"maas-controller-fd6675fb9-fn46r\" (UID: \"44038ae5-b8f1-42b8-ae98-b86ed3e49e67\") " pod="opendatahub/maas-controller-fd6675fb9-fn46r"
May 21 16:45:39.043285 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:39.043261    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxm9\" (UniqueName: \"kubernetes.io/projected/44038ae5-b8f1-42b8-ae98-b86ed3e49e67-kube-api-access-lxxm9\") pod \"maas-controller-fd6675fb9-fn46r\" (UID: \"44038ae5-b8f1-42b8-ae98-b86ed3e49e67\") " pod="opendatahub/maas-controller-fd6675fb9-fn46r"
May 21 16:45:39.146933 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:39.146840    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd6675fb9-fn46r"
May 21 16:45:39.270449 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:39.270420    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fd6675fb9-fn46r"]
May 21 16:45:39.273805 ip-10-0-141-23 kubenswrapper[2567]: W0521 16:45:39.273781    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44038ae5_b8f1_42b8_ae98_b86ed3e49e67.slice/crio-0f4d2beb0436479d3bf64de1fdd963a02ad08bd27985af33e0af395b3c17a95b WatchSource:0}: Error finding container 0f4d2beb0436479d3bf64de1fdd963a02ad08bd27985af33e0af395b3c17a95b: Status 404 returned error can't find the container with id 0f4d2beb0436479d3bf64de1fdd963a02ad08bd27985af33e0af395b3c17a95b
May 21 16:45:40.044861 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:40.044825    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd6675fb9-fn46r" event={"ID":"44038ae5-b8f1-42b8-ae98-b86ed3e49e67","Type":"ContainerStarted","Data":"77001a5d05f24ce6ed05ba61c8d0deffb08bc1582aec98222ccf983328106d71"}
May 21 16:45:40.044861 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:40.044863    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd6675fb9-fn46r" event={"ID":"44038ae5-b8f1-42b8-ae98-b86ed3e49e67","Type":"ContainerStarted","Data":"0f4d2beb0436479d3bf64de1fdd963a02ad08bd27985af33e0af395b3c17a95b"}
May 21 16:45:40.045292 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:40.044954    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fd6675fb9-fn46r"
May 21 16:45:40.063188 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:40.063133    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-fd6675fb9-fn46r" podStartSLOduration=1.719029805 podStartE2EDuration="2.063119587s" podCreationTimestamp="2026-05-21 16:45:38 +0000 UTC" firstStartedPulling="2026-05-21 16:45:39.275429578 +0000 UTC m=+829.439162192" lastFinishedPulling="2026-05-21 16:45:39.619519359 +0000 UTC m=+829.783251974" observedRunningTime="2026-05-21 16:45:40.060906601 +0000 UTC m=+830.224639250" watchObservedRunningTime="2026-05-21 16:45:40.063119587 +0000 UTC m=+830.226852221"
May 21 16:45:51.053393 ip-10-0-141-23 kubenswrapper[2567]: I0521 16:45:51.053363    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fd6675fb9-fn46r"
May 21 17:06:41.527036 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:41.527006    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-599c75dc45-lvm5w_356fd82e-ac95-4e2e-a456-b3c590c342db/authorino/0.log"
May 21 17:06:45.882306 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:45.882277    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-xmh77_61873eef-3266-4a00-a948-4500bdb9ce1d/manager/0.log"
May 21 17:06:46.002899 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:46.002872    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b7bc457ff-frv4z_c531c151-15f4-443c-9d4a-147d5873d01b/maas-api/0.log"
May 21 17:06:46.360384 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:46.360359    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fd6675fb9-fn46r_44038ae5-b8f1-42b8-ae98-b86ed3e49e67/manager/0.log"
May 21 17:06:46.483590 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:46.483559    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-v5w5q_c01f402f-b947-435a-9587-f57c7e762bed/manager/2.log"
May 21 17:06:46.605586 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:46.605557    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f66c9f4-9zks5_f16b16db-ba75-4d6f-8ac3-1583d63c934e/manager/0.log"
May 21 17:06:48.211433 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:48.211392    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-599c75dc45-lvm5w_356fd82e-ac95-4e2e-a456-b3c590c342db/authorino/0.log"
May 21 17:06:48.323704 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:48.323675    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-l87z9_f3060474-42b5-46c7-9ec1-95cc586d401d/manager/0.log"
May 21 17:06:48.431070 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:48.431043    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-p9vdm_5cefe289-a702-4ae2-83d8-dde37fb7b68a/manager/0.log"
May 21 17:06:49.445080 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:49.445046    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-d45ct_06f10c2d-7091-46a7-96cf-ee563c4cadcc/discovery/0.log"
May 21 17:06:49.660701 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:49.660671    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df99877bf-tr28z_11381953-0a7f-48c7-bb79-580e73346559/kube-auth-proxy/0.log"
May 21 17:06:49.776435 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:49.776367    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-cgq27_963b791d-317e-4277-acd2-c68036758c6e/istio-proxy/0.log"
May 21 17:06:49.885195 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:49.885174    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-xhq4m_d8be316f-2a8b-431f-8540-24554cdf6eb1/payload-processing/0.log"
May 21 17:06:50.569585 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:50.569556    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-zgkqv_b704abf6-598a-4a7d-8e5d-252424cef0a1/storage-initializer/0.log"
May 21 17:06:50.577045 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:50.577023    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-zgkqv_b704abf6-598a-4a7d-8e5d-252424cef0a1/main/0.log"
May 21 17:06:50.912811 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:50.912743    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr_3e5ca6ee-e937-429a-bd66-2f5c6c7af748/storage-initializer/0.log"
May 21 17:06:50.919580 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:50.919560    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-2z7kr_3e5ca6ee-e937-429a-bd66-2f5c6c7af748/main/0.log"
May 21 17:06:57.435673 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:57.435644    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r5j8w_4f65c605-86d8-4470-9f2c-9e982dc8ef40/global-pull-secret-syncer/0.log"
May 21 17:06:57.549235 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:57.549209    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m4jzh_050c91f4-c50a-423a-8e94-f12a0076a702/konnectivity-agent/0.log"
May 21 17:06:57.613583 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:06:57.613551    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-23.ec2.internal_218c7e0110a630061b5b90203b83e66e/haproxy/0.log"
May 21 17:07:02.049802 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:02.049763    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-599c75dc45-lvm5w_356fd82e-ac95-4e2e-a456-b3c590c342db/authorino/0.log"
May 21 17:07:02.085366 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:02.085334    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-l87z9_f3060474-42b5-46c7-9ec1-95cc586d401d/manager/0.log"
May 21 17:07:02.109271 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:02.109243    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-p9vdm_5cefe289-a702-4ae2-83d8-dde37fb7b68a/manager/0.log"
May 21 17:07:04.359317 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:04.359287    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgrvb_4187f12f-1f85-4c9a-bcee-acd75a3e7e9e/node-exporter/0.log"
May 21 17:07:04.377400 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:04.377376    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgrvb_4187f12f-1f85-4c9a-bcee-acd75a3e7e9e/kube-rbac-proxy/0.log"
May 21 17:07:04.398552 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:04.398527    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgrvb_4187f12f-1f85-4c9a-bcee-acd75a3e7e9e/init-textfile/0.log"
May 21 17:07:06.135583 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.135538    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"]
May 21 17:07:06.139185 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.139161    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.141634 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.141613    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2sr2x\"/\"default-dockercfg-6xm2l\""
May 21 17:07:06.141755 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.141637    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sr2x\"/\"kube-root-ca.crt\""
May 21 17:07:06.142641 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.142618    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sr2x\"/\"openshift-service-ca.crt\""
May 21 17:07:06.145025 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.145002    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"]
May 21 17:07:06.234273 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.234234    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-podres\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.234449 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.234289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-lib-modules\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.234449 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.234349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqst\" (UniqueName: \"kubernetes.io/projected/361a574a-bec0-4f63-8606-9a6cd29a4f1b-kube-api-access-xzqst\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.234449 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.234426    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-proc\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.234449 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.234478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-sys\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.335768 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335740    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-proc\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.335768 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335770    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-sys\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.335982 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335803    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-podres\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.335982 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335831    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-lib-modules\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.335982 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335845    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqst\" (UniqueName: \"kubernetes.io/projected/361a574a-bec0-4f63-8606-9a6cd29a4f1b-kube-api-access-xzqst\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.335982 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335854    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-proc\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.335982 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335869    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-sys\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.336230 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.335989    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-lib-modules\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.336230 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.336055    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/361a574a-bec0-4f63-8606-9a6cd29a4f1b-podres\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.343256 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.343235    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqst\" (UniqueName: \"kubernetes.io/projected/361a574a-bec0-4f63-8606-9a6cd29a4f1b-kube-api-access-xzqst\") pod \"perf-node-gather-daemonset-xms8d\" (UID: \"361a574a-bec0-4f63-8606-9a6cd29a4f1b\") " pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.449714 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.449652    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:06.575946 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.575919    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"]
May 21 17:07:06.578607 ip-10-0-141-23 kubenswrapper[2567]: W0521 17:07:06.578578    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod361a574a_bec0_4f63_8606_9a6cd29a4f1b.slice/crio-0aae062feb3b7d8e8fc84f670a68ca49be1f090719552f65fe78c4ccb0159355 WatchSource:0}: Error finding container 0aae062feb3b7d8e8fc84f670a68ca49be1f090719552f65fe78c4ccb0159355: Status 404 returned error can't find the container with id 0aae062feb3b7d8e8fc84f670a68ca49be1f090719552f65fe78c4ccb0159355
May 21 17:07:06.580118 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.580101    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:07:06.948377 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:06.948350    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bc4d54864-28b8t_7ce3af8d-3920-4e29-b994-35b9ee4c4720/console/0.log"
May 21 17:07:07.353466 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:07.353433    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d" event={"ID":"361a574a-bec0-4f63-8606-9a6cd29a4f1b","Type":"ContainerStarted","Data":"169b265f59e3a6d0aa6e1df8c76c55c08197b7c7cfda1dc1b4a2f7380d9be554"}
May 21 17:07:07.353875 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:07.353480    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d" event={"ID":"361a574a-bec0-4f63-8606-9a6cd29a4f1b","Type":"ContainerStarted","Data":"0aae062feb3b7d8e8fc84f670a68ca49be1f090719552f65fe78c4ccb0159355"}
May 21 17:07:07.353875 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:07.353635    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:07.368653 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:07.368598    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d" podStartSLOduration=1.368582567 podStartE2EDuration="1.368582567s" podCreationTimestamp="2026-05-21 17:07:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:07:07.368047544 +0000 UTC m=+2117.531780179" watchObservedRunningTime="2026-05-21 17:07:07.368582567 +0000 UTC m=+2117.532315203"
May 21 17:07:08.166990 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:08.166962    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bsk9_33549198-9578-4968-b8e1-6b47b2fbb150/dns/0.log"
May 21 17:07:08.185474 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:08.185442    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bsk9_33549198-9578-4968-b8e1-6b47b2fbb150/kube-rbac-proxy/0.log"
May 21 17:07:08.330307 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:08.330276    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sncdc_77db0607-0f8c-4c1f-906c-7824dd957b28/dns-node-resolver/0.log"
May 21 17:07:08.776601 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:08.776570    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-58c8d547f7-n7hfk_1e04fb50-d402-4ff0-a6ad-34f0956080fe/registry/0.log"
May 21 17:07:08.838220 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:08.838193    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrsgr_6ec0b90a-32d9-47c2-b5cc-c41d6ec4cf8d/node-ca/0.log"
May 21 17:07:09.708795 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:09.708767    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-d45ct_06f10c2d-7091-46a7-96cf-ee563c4cadcc/discovery/0.log"
May 21 17:07:09.748448 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:09.748424    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df99877bf-tr28z_11381953-0a7f-48c7-bb79-580e73346559/kube-auth-proxy/0.log"
May 21 17:07:09.798113 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:09.798086    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-cgq27_963b791d-317e-4277-acd2-c68036758c6e/istio-proxy/0.log"
May 21 17:07:09.856197 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:09.856170    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-xhq4m_d8be316f-2a8b-431f-8540-24554cdf6eb1/payload-processing/0.log"
May 21 17:07:10.438247 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:10.438217    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ddxzv_73fb1e00-d98d-4eb5-8068-a4b0994a9988/serve-healthcheck-canary/0.log"
May 21 17:07:11.131039 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:11.131010    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lpq4h_b8775f11-d28d-4da5-899f-3c9f9efd62a1/kube-rbac-proxy/0.log"
May 21 17:07:11.150357 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:11.150333    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lpq4h_b8775f11-d28d-4da5-899f-3c9f9efd62a1/exporter/0.log"
May 21 17:07:11.169943 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:11.169920    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lpq4h_b8775f11-d28d-4da5-899f-3c9f9efd62a1/extractor/0.log"
May 21 17:07:13.050909 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:13.050876    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-xmh77_61873eef-3266-4a00-a948-4500bdb9ce1d/manager/0.log"
May 21 17:07:13.081124 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:13.081100    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b7bc457ff-frv4z_c531c151-15f4-443c-9d4a-147d5873d01b/maas-api/0.log"
May 21 17:07:13.191880 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:13.191841    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fd6675fb9-fn46r_44038ae5-b8f1-42b8-ae98-b86ed3e49e67/manager/0.log"
May 21 17:07:13.211955 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:13.211926    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-v5w5q_c01f402f-b947-435a-9587-f57c7e762bed/manager/1.log"
May 21 17:07:13.222333 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:13.222313    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-v5w5q_c01f402f-b947-435a-9587-f57c7e762bed/manager/2.log"
May 21 17:07:13.260380 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:13.260357    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f66c9f4-9zks5_f16b16db-ba75-4d6f-8ac3-1583d63c934e/manager/0.log"
May 21 17:07:13.366371 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:13.366300    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2sr2x/perf-node-gather-daemonset-xms8d"
May 21 17:07:14.467649 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:14.467614    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-75krr_bc7ddd25-e02d-43ef-add2-89026b7021b6/openshift-lws-operator/0.log"
May 21 17:07:20.699445 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.699416    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppxx2_76377b5f-4ec3-427a-9392-81c53727f5c8/kube-multus-additional-cni-plugins/0.log"
May 21 17:07:20.734265 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.734240    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppxx2_76377b5f-4ec3-427a-9392-81c53727f5c8/egress-router-binary-copy/0.log"
May 21 17:07:20.772270 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.772242    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppxx2_76377b5f-4ec3-427a-9392-81c53727f5c8/cni-plugins/0.log"
May 21 17:07:20.807344 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.807311    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppxx2_76377b5f-4ec3-427a-9392-81c53727f5c8/bond-cni-plugin/0.log"
May 21 17:07:20.844070 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.844044    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppxx2_76377b5f-4ec3-427a-9392-81c53727f5c8/routeoverride-cni/0.log"
May 21 17:07:20.884145 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.884124    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppxx2_76377b5f-4ec3-427a-9392-81c53727f5c8/whereabouts-cni-bincopy/0.log"
May 21 17:07:20.926107 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.926083    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppxx2_76377b5f-4ec3-427a-9392-81c53727f5c8/whereabouts-cni/0.log"
May 21 17:07:20.996122 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:20.996052    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xxhgn_b58aa08a-5399-4e2d-a44c-428be7f298da/kube-multus/0.log"
May 21 17:07:21.058913 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:21.058888    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kc2cf_02c46b8c-6c40-47ce-8dc3-a46c30350906/network-metrics-daemon/0.log"
May 21 17:07:21.111210 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:21.111182    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kc2cf_02c46b8c-6c40-47ce-8dc3-a46c30350906/kube-rbac-proxy/0.log"
May 21 17:07:22.471941 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.471910    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/ovn-controller/0.log"
May 21 17:07:22.497813 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.497783    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/ovn-acl-logging/0.log"
May 21 17:07:22.515857 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.515835    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/kube-rbac-proxy-node/0.log"
May 21 17:07:22.534710 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.534685    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/kube-rbac-proxy-ovn-metrics/0.log"
May 21 17:07:22.551591 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.551572    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/northd/0.log"
May 21 17:07:22.570195 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.570168    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/nbdb/0.log"
May 21 17:07:22.588709 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.588693    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/sbdb/0.log"
May 21 17:07:22.675056 ip-10-0-141-23 kubenswrapper[2567]: I0521 17:07:22.675032    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m87sz_b8203791-5fa6-4800-90b6-ce0dce517ecb/ovnkube-controller/0.log"